Concurrent tasks refer to those that are being carried out at the same time, whether in the cloud or on your local machine. However, there may be some slight variations to take note of.
The term local concurrent runs refers to the number of tasks currently being executed on the local machine. The Free Plan & Basic Plan have a maximum limit of 2 concurrent local runs, while all other plans offer unlimited concurrent runs.
Cloud concurrent runs refer to the number of tasks being simultaneously executed in the Cloud.
💡TIP:
You can view the current runs in your account by utilizing the Filters feature.
Frequently Asked Questions
Q1:
If a plan includes 6 cloud nodes (like the Standard Plan), does this indicate that there must be 6 tasks running simultaneously in the cloud?
A1:
When an account is allocated with 6 cloud nodes, it is feasible to have 6 tasks operating concurrently in the Cloud. However, in order to optimize extraction speed, Octoparse will consistently endeavor to divide the task into smaller sub-tasks. Once divided, each sub-task will be executed on an individual cloud node to expedite data extraction. In certain circumstances, a single task may utilize more than 1 cloud node (For further information on task splitting, please refer to task splitting). Naturally, if task splitting is deemed unnecessary, the option to disable it is available, ensuring that 6 tasks will consistently operate concurrently in the Cloud.
💡TIPS:
1. If the division of tasks is not desired, it is possible to deactivate it within the task settings.
2. In order to expedite the process of Cloud extraction, it is recommended to reduce the number of tasks running concurrently. This will result in a greater availability of cloud nodes.
3. One may also establish the priority for the current list.
