All Collections
FAQ
Why can't I get data scraped in order during cloud runs?
Why can't I get data scraped in order during cloud runs?
Updated over a week ago

When running tasks with "Cloud Run," the task is split into multiple sub-tasks. Multiple sub-tasks will run in the cloud by multiple servers at the same time. Data scraped from the sub-tasks are transferred to us at the same time. That's why the data is out of order.

Knowing the working principle of could extraction, we can then solve it.


Disable task split - to run all tasks under one IP

  • Click the Task Settings button on the upper right side of the Octoparse interface

  • Go to Run Settings

  • Tick Disable task split

  • Click Save

After this option is selected, the task will not be split into sub-tasks. So the data will be in the same order as the local run. In case you still find the order different, you can try to set up some wait time for the Extract Data action.

Extract_Data.png

Note: The solution will slow the scraping speed as the Cloud speed depends on how many sub-tasks are running at the time.

Did this answer your question?