How to scrape links in a Google Sheet

This template scrapes data from a website to a Google Sheet. It loops through links in the sheet, extracts data, and updates the sheet. After each loop, it deletes each link. Configuration takes minutes.

Get started: create your Google Sheet

Create a new Google Sheet. You can do this in your Chrome browser by entering the shortcut 'sheet.new', assuming you already have an account. Name your sheet something like Web Scraper and set up a tab called "Page links". Add another tab called "Data".

Install the Web scraper

To install this Web scraper click "Install template". If you’re a new user, you’ll have to click "Install Chrome extension" and create a free axiom.ai account before you can edit the template.

Once installed, click "Start".

axiom.ai will guide you through the steps you need to configure in the app.

Configure your Web scraper in minutes

  • 1.0 Read data from a Google Sheet
    • Spreadsheet: Search for the Google Sheet you created. Once found, click to select.
    • Sheet name: Choose the sheet tab called "Amazon product links".
  • 2.0 Loop through data
    • 2.1 Go to page
      • Enter URL: Click 'Insert Data', select google-sheet-data, and choose the column with the links in it.
    • 2.2 Get data from bot's current page
      • Select: Point and click to choose the data you wish to scrape.
      • Max Results: Set to match the number of columns of data you selected to scrape.
    • 2.3 Write data to a Google Sheet
      • Spreadsheet: Search for the Google Sheet you created. Once found, click to select.
      • Sheet name: Choose the tab you created.
      • DATA: Select [scrape-data].
      • Clear data before writing | Add to existing data: Set this option to "Add to existing".
    • 2.4 Delete rows from a Google Sheet
      • Spreadsheet: Search for the Google Sheet you created. Once found, click to select.
      • Sheet name: Choose the tab you created for links.
      • First row: Set to 1.
      • Last row: Set to 1.

Run your Web scraper

We suggest running a test first, stopping the bot after a few loops, and reviewing the scraped data.

Customize your template

Like all Axiom templates, you can use our no-code bot builder to customize any bot according to your requirements.

Troubleshooting

We recommend you watch the video to troubleshoot.

  • Want to set an amount of loops?
    In Step 1.0, set a Last Cell. For example, AE100 will scrape 100 rows.
  • Selectors fail to find content?
    In Step 2.2 – Get data from bot's current page, try reselecting or using custom selectors.
  • Slow running scraper?
    In the same step, toggle Configure scraper, then set No. of retry... to 1.
  • Want to speed the scraper up?
    Set Max Results to match the number of columns you selected to scrape.
  • No data written?
    In Step 2.3 – Write Data to a Google Sheet, check that Data is set to [scrape-data].
  • Keeps overwriting data?
    Make sure Add to existing is selected in the same step.

We offer excellent customer support. If you need help, get in touch. If you are keen to learn more about scraping, take a look at these guides: web scraping with an AI, Killer-problems with web scrapers and how to use Custom CSS selectors.

On this page