Octoparse offers two modes for both local and cloud extraction tasks: Standard Mode and Boost Mode.
What is the difference between Boost Mode and Standard Mode?
Boost Mode | As the name suggests, this mode allows for faster execution of tasks compared to Standard Mode. Tasks are divided into smaller sub-tasks and executed simultaneously. |
Standard Mode | In this mode, tasks are not divided, resulting in a limited scraping speed. |
NOTE:
In versions 8.4 or earlier, all tasks are automatically configured to execute in Boost Mode within the Cloud environment, provided they are capable of being divided.
Whether initiating the task from the Dashboard or scheduling it for execution in the Cloud, it will operate in Boost Mode if it can be partitioned.
The option to establish Local Boost Mode as the default setting is available within your account preferences. Once configured, all local executions (whether manually initiated or scheduled) will operate in Boost Mode if they are capable of being divided.
What tasks are suitable for using the Boost Mode?
When a task is splittable, it can be broken down into multiple sub-tasks that can be completed at the same time, resulting in a quicker extraction process.
Octoparse offers 5 different loop modes, but only 3 of them can be split.
List of URLs (most used)
Text list
Fixed list
In short, the task should consist of a Loop Item with a Loop Mode of either URL List, Text List, or Fixed List.
Why is the option for Boost Mode not visible to me?
Some tasks cannot use Boost Mode because they cannot be split into smaller subtasks. This means no Loop Item contains a URL List, Text List, or Fixed List. In these cases, Octoparse will automatically run the task in Standard Mode.
Octoparse offers different levels of simultaneous local runs in Boost Mode, depending on the subscription package chosen. Even Free Plan users can use Boost Mode for better local extraction. For more details on the number of concurrent local Boost Mode runs included in each package, please see the table below.
Plans | Concurrent local runs using Boost Mode |
Free | 3 times |
Basic | 5 times |
Standard | 2 tasks |
Professional | 5 tasks |
Enterprise | 10 tasks |
Users with a free plan are permitted to utilize Boost Mode a maximum of 3 times in total to test the feature. Each execution is considered as one instance. They have the option to execute a single task three times or execute three different tasks.
In contrast, users with a Standard or higher plan are not subject to any restrictions on the frequency of Boost Mode usage. They may utilize it as frequently as desired, with the caveat that they must not surpass the concurrent run limitations. For instance, standard plan users are limited to a maximum of two tasks running simultaneously in Boost Mode.