Cloud extraction is the most important feature of our premium plans. You can set up tasks to run in the cloud, and even schedule them to run at a certain frequency.
Many users may have noticed that some tasks are in queued status and are executed immediately after they are set up to run in the cloud.
Don't worry, you can refer to this article to find out why.
The two reasons are shown in the menu on the right.
1. All Cloud nodes under your account are occupied
The Octoparse cloud service is supported by hundreds of Cloud nodes. A task takes up at least one node. Splittable tasks (tasks containing URL list, Fixed list or Text list) will use several or all of the nodes under one account to speed up the extraction process. If you have performed several tasks that take up all the nodes, you will see the other tasks in the queue status.
To check how many cloud nodes one task is using, you can click on the cloud button on the Dashboard, then a Cloud live log will be shown. You can see all the details of your running task.
In the subtask overview, the number of running represents the number of nodes that are occupied.
By looking at Subtask Details (as shown below), you can see how your task is working while running in the cloud.
Note: The Standard Plan has 4-6 Cloud nodes (which means it can run at most 4-6 subtasks at the same time) while the Professional Plan has 15-20.
2. The number of tasks exceeds the limit
If your tasks are not taking up all the nodes and other tasks are still not running, you need to check the maximum number of tasks running in parallel that you set. The default maximum number of tasks running in parallel is 6 for the standard plan (20 for the professional plan), which means you can only run up to 6 tasks at the same time (20 tasks for the professional plan).
To modify the maximum number of tasks running in parallel:
STEP 1. Click the account settings button at the bottom of the sidebar menu.
STEP 2. Select the desired number from the drop-down options.
The tasks in the queue will start automatically once the Cloud nodes are released from the other tasks. You don't need to worry about it.
If you have too many tasks to finish within a short time, we suggest that you upgrade to a higher plan to have more Cloud nodes.