Speeding up slow browser bot execution
Unfortunately, bots with faster execution can lead to more errors.
Axiom prioritises reducing errors - this means bots can sometimes be slow!
Here's some tips to speed up your bots:
# Set a maximum number of results
If you know you need to scrape 1 result per page (or 5, or 10 etc.) set 'Max results' to the number of results you need to scrape.
This means axiom will will stop once it has scraped 1 result, then move to the next iteration of the loop.
# Use the Keyboard
Using Keyboard shortcuts and 'Tabbing' between inputs can be faster than selecting 'Enter Text' to enter data.
# Jump ahead with conditional logic
This may only apply to some scenarios.
Let's look at the example of entering data into multi-step form with 5 steps.
If at step 2, it is evident steps 3 and 4 are not required, you can jump ahead to Step 5 using conditional logic.
You could also end the automation early. See:
# Reduce the wait time on scrapers
If your bot seems to be taking a long time over scraping, there are several things you can do to try and speed it up. Please note that the axiom scraper is configured by default to maximise accuracy across a wide range of sites, so by changing these options you might introduce some innaccuracies - the scraper can be configured to go too fast for the website!
To configure these options, open the "Configure Scrape" optional parameter on the scrape step. There are two options to choose from which can help speed up your bot:
- Wait time between scrolls (ms): This controls the default amount of time the scraper wait between each scroll. Lower this to increase speed.
- # of attempts when results not found: When no results are found, the scraper will try again to make doubly sure that the scrape has finished. You can set the number of times this happens; 0 will never re-check.
# Disable page change monitoring
By default Axiom waits for a page to finish making changes. This is to make sure that page contents which load in dynamically have fully loaded.
Sometimes, this can slow down an automation. This is most common when there are animated elements, and Axiom must take a while to determine whether the animation is related to page loads or not.
In these cases, you can turn off the page monitoring to skip it. Note you may need to add back manual waits in these cases, in case Axiom starts jumping ahead.
You can turn this on with the following steps:
- Clicking the drop-down menu at the top right of the axiom builder
- Selecting "Settings"
- Clicking the "Disable page monitoring" tab
- Tick the checkbox for "Disable page change monitoring"