Scrape a page into a Google Sheet
A good first automation. You'll scrape a table or list off a page and write every row into a Google Sheet. By the end you'll understand how data flows from one step to the next in axiom.ai, the mental model behind every automation you build after this.
- Scrape data from a webpage
- Save to a Google Sheet
Start building opens the Chrome extension with these lines filled in. Click Try agent there and the agent opens the site, builds the steps, test-runs them and hands you the automation in the Builder. It stops and asks if it needs a login or a choice from you.
What the agent builds
Three steps, in this order:
- Go to page: opens the page you want to scrape.
- Get data from bot's current page: scrapes the rows. If the page has a Next button, the agent sets the pager so every page is scraped.
- Write data to a Google Sheet: adds each scraped row to your sheet.
Name the site and the sheet in your description, for example Scrape the job listings on example.com/jobs and Save them to my Jobs sheet, and the agent fills those in. Leave them out and it asks.
Once it runs, add a schedule so it repeats every hour, day or week.
Build it manually
Prefer to add the steps yourself? These are, loosely, the steps the agent builds. The agent reads the page as it goes, so it may add steps you would not think of up front, such as a pager, a wait for a slow page, or a scrape setting.
Step 1: Open the page
- Click Add step and search for Go to page.
- Select Go to page to add it.
- In
Enter URL, enter the URL of the page you want to scrape.
Step 2: Scrape the data
- Click Add step and search for Get data.
- Select Get data from bot's current page to add it.
- Click
Selectand click one item of the data you want. axiom.ai detects the repeating rows and highlights them all. - If the list runs over several pages, click
Find pagerand select the Next button.
Step 3: Write the data to a sheet
- Click Add step and search for Google Sheet.
- Select Write data to a Google Sheet to add it.
- Connect your Google account if you have not already.
- In
Spreadsheet, pick the sheet, and inSheet name, pick the tab to write to. - In
DATA, click Insert Data and choose the scraped data from step 2.
Step 4: Run it
- Click Run and check the rows arrive in the sheet.
- If they do, click Save, then set a schedule to run it automatically.
That's the whole shape: open the page, scrape the data, reference it in the next step, write it out.
Things worth knowing
- The agent only scrapes what you name. Get the title, price and rating gets three columns; Scrape data gets whatever repeats on the page.
- Scraped data comes back as a 2D array of rows and columns. Every step that reads another step's data reads it in this shape.
- The selector tool looks for repeating patterns. Click one item and axiom.ai finds the rest. Click a second example if the first doesn't capture everything.
- If the page loads slowly, use Configure scraper settings on the scrape step to add wait time. Worth checking if you see missing rows.
Next steps
- The Get data from bot's current page reference covers pagers, limits and scraper settings.
- Fill a form from a spreadsheet is the natural second automation: the same data, going the other way.
Quick starts: build from description with one click
Scrapers that build on this one, from a list of links to a whole site. Each guide carries a Build from description button: one click opens the extension with the lines filled in and the agent builds it, or follow the steps yourself.
Scrape links from a website into a Google Sheet
- Go to the listing page I give you
- Scrape every product link on it
- Do every page of results
- Add the links to my Google Sheet
Scrape every page in a list of links into a Google Sheet
- Open each link in the Links tab of my sheet
- Scrape the title, price and description
- Add them to the Data tab
- Delete the link row once it is scraped
Scrape data from a list of URLs in a Google Sheet
- Open each link in column A of my Google Sheet
- Ask me which data to scrape from each page
- Put the details in that URL's row from column B
Extract data from HTML with AI into a Google Sheet
- Open each URL in column A of my sheet
- Ask me which data the AI should extract
- Put the results in that URL's row from column B
Extract email addresses from a website into a Google Sheet
- Go to the page I give you
- Find every email address on it
- Add them to my Google Sheet, no duplicates
Scrape Amazon product data into a Google Sheet
- Open each Amazon product link in my Google Sheet
- Scrape the title, price and rating
- Add them to the Data tab of my sheet
- Delete the link row once it is scraped