How to extract values from scraped data with ChatGP

Easy • 3 minutes

This beginner template will guide complete novices on creating a bot to scrape and then extract data using ChatGPT from any website.

First, we will teach you how to extract data from a LinkedIn profile using ChatGPT and Axiom’s web scraper. You will then learn how easy it is to write data to a Google Sheet. Finally, we will guide you in transforming this template into a power scraper that can loop through hundreds of pages of extracting data. Before you start, please note you will need an API key for Chat GPT and a blank Google Sheet.

In this guide, we will be using LinkedIn to test this template. However, you can use this template with any website.

# Install the ChatGPT data extractor template

To begin, click the button to install the template. If you're new, our Chrome Store page will load; install our Extension; Create an Account. Finally, we will add the ChatGPT template to your account. 📢 New users get 30 free mins of runtime to test. 👍

# First, lets do a simple scrape then extract data using ChatGPT

Before we can test this template, we need to do three small bits of configuration then we can scrape!

Step 1.1: Go to page - Add a URL to a LinkedIn profile. (opens new window). Feel free to use mine and connect 👋🏾
Step 1.2: Get data from a webpage - Use the Selector tool, select all the content on the page
Step 2: Extract data with chat GPT - Add you API key then set Extract Values to Linkedin profile template

Below: How to configure the ChatGPT step, Need help? Let us show you how in the video. (opens new window)

# Lets see the magic and do a test run

Great job! Now click run lets scrape some data. Its not going to print in a Google sheet yet you will see the data pop up in your window. Thats the Display message step (Its handy for testing as you make your Axioms). We test are bots on the desktop app before using the cloud.

# Now, learn how to write data to a Google Sheet

You will need a blank Google Sheet add two tabs to the sheet and call them 'Links' and 'Data'. This won't take long we just need to add a single step to the template.

Add A ‘Write data to Google Sheet’ step at the end of the Axiom it should be step 4, then configure the step
Spreadsheet - Search for and add your Google Sheet
Sheetname - Select the tab you are writing data to
Write options - Add to existing data

Thats it click run and write some data to the Google sheet 👍 Not working? See how here. (opens new window) You can learn more about using Google sheets with Axiom here. (opens new window)

# Transform this template into a Power Scraper

👋 We will be changing the template now to loop through links stored in a Google sheet. Now lets transform this template into a power scraper that can loop through hundreds of pages. Its acutally pretty simple we only need to add three more steps. You will need to add some profile links to you Google Sheet in order to test.

# Add a ‘Read Data Google sheet’ step to the start of the bot

Add A ‘Read from Google Sheet’ step at the start of the Axiom it should be Step 1 - then configure the step
Spreadsheet - Search for and add your Google Sheet
Sheetname - Select the tab with your links in
First col and Last col - Set to A1 👋 we only want to read a single row of data
Go to page - Remove the url click insert and pass the data from the Google Sheet

Below: The preview should show a single row of data, See how. (opens new window)

Below: URLs from the Google Sheet data inserted into the Go to page step.

# Now add a ‘Delete rows from a Google Sheet’ step

Add A ‘Delete rows from a Google Sheet’ at the end of the Axiom after the 'Write data to a Google Sheet' step
Spreadsheet - Search for and add your Google Sheet
Sheetname - Select the tab with your links in

Below: The Delete Rows step, See how to set it up. (opens new window)

# Finally lets make the bot loop with a Jump to another step

Add A ‘Jump to another step’ at the very end of the Axiom
Jump to step - Set to 1
Maximum cycles - This controls the amount of links you scrape in a run. For testing set to two.

Below: The Jump step, See how to set it up. (opens new window)

Axiom.ai ChatGPT template should look like this

# Finished! The final template should look like this

Awesome work you have completed your first Power Scraper, its ready to use. Remeber you can reuse these skills you have learnt to scrape any website.

# Using this template on other websites

You must make two minor alterations to use this template successfully on other websites. First, you must select the data on the new site and then change the values in the ChatGPT step.