Batching Bot Runs

Batching bot-runs has several advantages:

  • Data is retrieved continuously - not just at the end
  • A bot can resume if interrupted, or if an error occurs
  • Batches can be scheduled at regular intervals

# Setup batching

You'll need to integrate these 5 steps:

  1. Read data from Google Sheet
  2. Interact with a page's interface
  3. Write data to a Google Sheet
  4. Delete rows from a Google Sheet
  5. Jump to another step (Optional)

1. Read data from Google Sheet

  • Choose the number of rows you'd like to process in each batch (e.g. 10 rows)
  • If you choose 'First Cell' A1, and 'Last Cell' A10, 10 rows will be processed in each batch
  • We recommend creating a dedicated INPUT sheet for this

2. Interact with a page's interface

  • This will loop through the User Interface as many times as there are rows passed to it (e.g. 10 times)

3. Write data to a Google Sheet

  • If you're scraping data, this will write the output of X rows scraped (e.g. 10 pages of scraped data)
  • We recommend creating a dedicated OUTPUT sheet for this

4. Delete rows from a Google Sheet

  • If you chose 10 rows in step 1, remove them from your INPUT sheet here.
  • Now axiom will select the next 10, in the next batch

5. Jump to another step(Optional)

  • Jump to step 1 to start processing the next batch straight away
  • If you are using a scheduling system to run axiom regularly, this step is optional