What is Bulk Run?
Bulk Run lets you run many data extraction tasks from one list of URLs. The tasks are queued and run in batches.
This feature is particularly useful when you need to extract data from many similar pages, such as product details or business listings. One bulk run can cover a whole list of URLs, up to your plan's bulk-run limit.
Video
You can click the icon that looks like a list, to see the chapters available in the video.
Prerequisites
Before using Bulk Run, ensure you have:
A robot trained to extract data from detail pages
A CSV file containing the URLs you want to process
You can generate this list of URLs manually through your own internal process, or
You can generate this list of URLs by creating a robot to extract a list of URLs
Sufficient credits for your extraction needs
How to create a Bulk Run
Navigate to the Tables tab of the robot that scrapes the detail page
Click the "Import CSV" button on the bottom left
Upload your CSV file containing URLs
Map your CSV columns to the robot's parameters
Review and start the bulk run
Working with integrations
When using Bulk Run with integrations:
Maintain consistent column headers in connected spreadsheets
Recalibrate integrations if column names need to change
Test your integration setup with a small batch first
Managing Bulk Run tasks
You can manage your Bulk Run tasks from the History tab:
Monitor progress in real-time
Pause or stop runs as needed
Download results when complete
Troubleshooting
Common issues and solutions:
Mismatched URL formats: Ensure URLs match the robot's training format
Integration errors: Verify column mappings are correct
Failed runs: Check individual URL results for specific errors