How to monitor a web page and send email

Monitor a website for new products, this bot is a simple and effective way to achieve your goal. You will need to use this bot on a listing or search page.

The bot scrapes a list of content, such as titles or prices comparing them against a previous scrape to monitor for changes.

This template is simple and adaptable to different websites, from products to stock listings. A Google Sheet is required to store data for comparison.

To use this template, you will first need to scrape a list of data into your sheet to compare against. We suggest you adpat this template.

Advantages to using this web monitoring design pattern

  1. Adaptable to different types of website
  2. Monitoring can be scheduled at regular intervals

Install the Monitor bot template

On this page click 'Install template'. If you are a new user you will be required to create an axiom.ai account before you can edit the template.

Prepare a Google Sheet

A Google sheet is required with a list of data to compare against.

Configure the bot

  • 1.0 Get data from bot's current page
    • URL: Insert the link of the page you wish to monitor.
    • Select: Point and click to select the content to monitor.
    • Find pager (optional): Select the “Next” button if the page is paginated.
    • Max Results: When testing, set to 10–20.
  • 2.0 Read data from a Google Sheet
    • Spreadsheet: Search for the Google Sheet you created.
    • Sheet name: Choose the sheet with the comparison data.
    • First cell / Last cell: Leave as default.
    • A preview of the data should now display.
  • 3.0 Remove results that do not contain certain words
    • Data: Click Insert data, select scrape-data.
    • Words: Click Insert data, select google-sheet-data.
    • Word matching mode: Leave set to "Any".
    • Match on word boundary: Leave unticked.
    • Columns (optional): Leave as default.
  • 4.0 If condition: Continue only if new content found
    • Data to check: Click Insert data, select [matching-word-data].
    • Words to check: Use default (a–z, 0–9).
    • Word matching mode: "Any".
    • Match on word boundary: Leave unticked.
    • Fail if condition not met: Tick this box.
    • Reverse condition: Leave unticked.
  • 5.0 Write data to a Google Sheet
    • Spreadsheet: Search for the Google Sheet you created.
    • Sheet name: Choose the sheet with existing content.
    • DATA: Select [matching-word-data].
    • Clear data before writing | Add to existing data: Set to "Add to existing data".
  • 6.0 Send email
    • Email addresses: Enter email addresses, one per line.
    • Email subject: Add your subject.
    • Email body: Add your message. Use Insert data to include [matching-word-data].

Test run

We always recommed doing a test run - click run then check the output from the scraper. In this case in the sheet.

Troubleshooting the monitoring Axiom

As mentioned at the top of the page, you will need to scrape data to compare against before running this bot.

  • All results write to the Google Sheet, check the 'Write' Step is set to 'word-matching-data'.
  • No message sent - perhaps no change has been detected.
On this page