This Link Scraper template extracts links from different webpages like listings, paginated, scrolling, and feed pages, and write them into a Google Sheet. It takes only a minute to set up.

We recommend scraping links with one Axiom then scraping the pages with another see this template.

Get started: create your Google Sheet

Create a new Google Sheet. You can do this in your Chrome browser by entering the shortcut 'sheet.new', presuming you already have an account. Name your sheet something like 'Link Scraper’ and set up a tab called 'Links'.

Install the link scraper

To install this Web scraper template click 'Install template'. If you’re a new user, you’ll have to click 'Install Chrome extension' and create a free Axiom.ai account before you can edit the template.

Once installed, click 'Start'.

Axiom.ai will guide you through the steps you need to configure in the app.

Configure your Link scraper in a minute

• Step 1.0 - Get a list of links to pages from a URL
  • URL - Enter a URL
  • Select - Point and click to select the links you wish to scrape
  • Find pager (if any) - Select the next button if the page is pagainated
  • Max Results - Set a number of links you wish to scrape
• Step 2.0 - Write Data to a Google Sheet
  • Spreadsheet - Search for the Google Sheet you created. Once found, click to select
  • Sheet name - Choose the tab you created
  • DATA - Select the '[scraped-link-data]'
  • Write options - Add to existing data

Run your link scraper

We suggest running a test first, setting max-results to 10, and reviewing the data.

Customize your template

Like all Axiom templates, you can use our no-code bot builder to customize any bot according to your requirements.

Tips

We recommend you watch the video to troubleshoot.

• Step 1.0 - Get data from bot's current page
  • Selectors fail to find content? Try re-selecting or using custom selectors. * Slow running scraper ? Toggle 'Configure scraper' then set 'No. of retry...' to 0
  • Speed the scraper up ? Set the max-results to match the amount of columns of data you selected to scrape
• Step 2.0 - Write Data to a Google Sheet
  • No data written? Check 'Data' is set to '[scraped-link-data]'
  • Keeps over writing data? Make sure 'Add to existing' is selected

We offer excellent customer support. If you need help, get in touch.

More web scraping templates

• Axiom template for Looping through pages with ChatGPT- Axiom template for batch scraping - Axiom template for scraping with keypress If you are keen to learn more about scraping, take a look at these guides web scraping with an AI, Killer-problems with web scrapers and how to use Custom CSS selectors.