How to scrape links from a website into a Google Sheet

This Link Scraper template extracts links from different webpages like listings, paginated, scrolling, and feed pages, and write them into a Google Sheet. It takes only a minute to set up.

We recommend scraping links with one Axiom then scraping the pages with another see this template.

Get started: create your Google Sheet

Create a new Google Sheet. You can do this in your Chrome browser by entering the shortcut "sheet.new", presuming you already have an account. Name your sheet something like 'Link Scraper’ and set up a tab called "Links".

To install this Web scraper template click "Install template". If you’re a new user, you’ll have to click "Install Chrome extension" and create a free axiom.ai account before you can edit the template.

Once installed, click "Start".

axiom.ai will guide you through the steps you need to configure in the app.

  • Step 1.0 Get a list of links to pages from a URL
    • URL: Enter the URL of the page you want to scrape.
    • Select: Point and click to select the links you wish to scrape.
    • Find pager (if any): Select the "Next" button if the page is paginated.
    • Max Results: Set the number of links you wish to scrape.
  • Step 2.0 Write data to a Google Sheet
    • Spreadsheet: Search for the Google Sheet you created. Once found, click to select.
    • Sheet name: Choose the tab you created.
    • DATA: Select [scraped-link-data].
    • Write options: Set to "Add to existing data".

We suggest running a test first, setting max-results to 10, and reviewing the data.

Customize your template

Like all Axiom templates, you can use our no-code bot builder to customize any bot according to your requirements.

Troubleshooting

We recommend you watch the video to troubleshoot.

  • Selectors fail to find content?
    In Step 1.0 – Get data from bot's current page, try re-selecting or use custom selectors.
  • Slow running scraper?
    In the same step, toggle Configure scraper, then set No. of retry... to 0.
  • Want to speed the scraper up?
    Set Max Results to match the number of columns you selected to scrape.
  • No data written?
    In Step 2.0 – Write Data to a Google Sheet, check that Data is set to [scraped-link-data].
  • Keeps overwriting data?
    Make sure Add to existing is selected in the same step.

We offer excellent customer support. If you need help, get in touch.

On this page