All Collections
Case Tutorial
E-Commerce
Scrape product information from Shopee
Scrape product information from Shopee
Updated over a week ago

You are browsing a tutorial guide for the latest Octoparse version. If you are running an older version of Octoparse, we strongly recommend you upgrade because it is faster, easier, and more robust! Download and upgrade here if you haven't already done so!

Shopee is now a leading e-commerce online shopping platform in Southeast Asia and Taiwan, it now serves 16 countries/regions. It provides customers with an easy, secure, and fast online shopping experience.

In this tutorial, we are going to show you how to scrape product information from Shopee.

Octoparse has 3 pre-defined templates to scrape Shopee and you can find them by searching on the home screen. You only need to input some parameters into the template to run it, the data will be scrapped.

If you prefer to build your own task, you can follow the steps below.

The URL below is the search results of the AirPods pro case in Shopee that we will be using as an example. We will show you the steps to extract the Product Name, Original Price, Sell Price, and more for example.

The main steps are shown in the menu on the right, and you can download the sample task file here.


1. Create a Go to Web Page - to open the target website

  • Create your task by inputting the URL in the search box on the homepage

  • Click the Start button nearby to move on

mceclip0.png

2. Log into your Shopee account - to access the webpage

The Shopee website now requires login to show any data. So you must log into your account first.

  • Toggle on Browse mode

  • Input your Shopee account and password to the web page and click LOG IN

  • Go to the settings of the Go to Web Page ->Options

  • Tick Use cookie

  • Click Use cookie from the current page

  • Click Apply to save the settings

  • Turn off Browse mode


3. Auto-detect web page data - to create a workflow

  • Click Auto-detect web page data and wait for it to complete

auto_detect.jpg
  • Untick Add a page scroll, then click Create workflow

    mceclip3.png

After creating the workflow, we need to check the data selected with the auto-detection. Go to Data Preview to see if you're okay with the current data output

  • Delete unnecessary data fields by clicking the 3-dot icon and then the delete icon

  • Modify the data field names by double-clicking the headers


4. Set up scroll down - to load more products

The website requires us to scroll down the page to load more products.

  • Click on the Go to Web Page

  • Click Options

  • Tick Scroll down the page after it is loaded

  • Choose Scroll for one screen

  • Set up the Repeat as 20

  • Click Apply to save

Scroll_settings.jpg
  • Click on Click to Paginate

  • Set up the same scroll settings


5. Run your task - get your target data

  • Save the task then click Run on the top right

  • Select Run on your device to run the task on your computer, or select Run in the Cloud to run the task in the Cloud (for premium users only)


Here is the sample data -

Did this answer your question?