This tutorial will guide you through setting up pagination using a "Next" button in Octoparse. We’ll cover two methods:
Set up manually (for cases where auto-detection fails)
For this example, we’ll use Amazon’s search results page:
🔗 Amazon Sunglasses Search
Method 1: Set up with auto-detect
Step 1: Use Auto-Detect
Click "Auto-detect web page data" in the Tips panel.
Click "Check" to see if Octoparse identifies the correct "Next" button.
The selected button will be highlighted on the webpage.
Step 2: Verify or Correct the Selection
If the wrong button is selected, click "Edit" and manually choose the correct "Next" button.
Uncheck "Add a page scroll" (not needed for this example).
Click "Create workflow" in the Tips panel.
Step 3: Test Pagination
In the workflow, click "Pagination" > "Click to paginate" to check if Octoparse moves to the next page.
If successful, your pagination is set up correctly!
Method 2: Set up manually
If auto-detection doesn’t work, you can manually configure pagination:
Step 1: Select the "Next" Button
Click the "Next" button on the webpage.
In the Tips panel, choose:
"Loop click next page" (if available)
"Loop click" (if the first option isn’t shown)
Step 2: Verify Pagination
Test pagination using the same steps as Method 1 (Step 3).
Ensure Octoparse successfully navigates to the next page.
Troubleshooting Tips:
✔ If pagination fails, double-check that the correct button is selected.
✔ Some websites may require a delay - adjust settings in Advanced Options if needed.
✔ For dynamic pages, consider using "Scroll to load data" before pagination.
With these methods, you can efficiently scrape multiple pages of data in Octoparse! 🚀