You are browsing a tutorial guide for the latest Octoparse version. If you are running an older version of Octoparse, we strongly recommend you upgrade because it is faster, easier, and more robust! Download and upgrade here if you haven't already done so!
Shopee is now a leading e-commerce online shopping platform in Southeast Asia and Taiwan, it now serves 16 countries/regions. It provides customers with an easy, secure, and fast online shopping experience.
In this tutorial, we are going to show you how to scrape product information from Shopee.
Octoparse has 3 pre-defined templates to scrape Shopee and you can find them by searching on the home screen. You only need to input some parameters into the template to run it, the data will be scrapped.
If you prefer to build your own task, you can follow the steps below.
The URL below is the search results of the AirPods pro case in Shopee that we will be using as an example. We will show you the steps to extract the Product Name, Original Price, Sell Price, and more for example.
The main steps are shown in the menu on the right, and you can download the sample task file here.
1. Create a Go to Web Page - to open the target website
Create your task by inputting the URL in the search box on the homepage
Click the Start button nearby to move on
2. Log into your Shopee account - to access the webpage
The Shopee website now requires login to show any data. So you must log into your account first.
Toggle on Browse mode
Input your Shopee account and password to the web page and click LOG IN
Go to the settings of the Go to Web Page ->Options
Tick Use cookie
Click Use cookie from the current page
Click Apply to save the settings
Turn off Browse mode
3. Auto-detect web page data - to create a workflow
Click Auto-detect web page data and wait for it to complete
After creating the workflow, we need to check the data selected with the auto-detection. Go to Data Preview to see if you're okay with the current data output
Delete unnecessary data fields by clicking the 3-dot icon and then the delete icon
Modify the data field names by double-clicking the headers
4. Set up scroll down - to load more products
The website requires us to scroll down the page to load more products.
Click on the Go to Web Page
Click Options
Tick Scroll down the page after it is loaded
Choose Scroll for one screen
Set up the Repeat as 20
Click Apply to save
Click on Click to Paginate
Set up the same scroll settings
5. Run your task - get your target data
Save the task then click Run on the top right
Select Run on your device to run the task on your computer, or select Run in the Cloud to run the task in the Cloud (for premium users only)
Here is the sample data -