Using Octoparse

Scrape data behind a login

How to set up the workflow if your target data is behind a login

Written by Scarlett
Updated over a week ago

Get page-level data (metadata, URL, title & HTML)

How to use Octoparse to extract page-level data, including webpage URL, page title, meta description, meta keywords, and HTML source code.

Written by Scarlett
Updated over a week ago

Scrape data from an IFrame

Written by Yina Huang
Updated over a week ago

Scrape data from JSON links

What is JSON? Why and how to use JSON in Octoparse?

Written by Yina Huang
Updated over a week ago

Add custom data field

Written by Yina Huang
Updated over a week ago

Click each link in a list and scrape data from new pages

Written by Yina Huang
Updated over a week ago

Extract star rating information

Written by Scarlett
Updated over a week ago

Scrape data from a table

Written by Scarlett
Updated over a week ago

Extract attributes of a web element (text, URL, HTML, etc)

Written by Kisad
Updated over a week ago

Create a task with a list of URLs

Written by Scarlett
Updated over a week ago

Scrape the selected dropdown option as a field

Written by Scarlett
Updated over a week ago

Scrape data from both listing and detail pages

Written by Scarlett
Updated over a week ago

Scroll within a designated area of a web page

Written by Scarlett
Updated over a week ago

Capture images from a carousel

Written by Scarlett
Updated over a week ago

Scrape Product Variants

Written by Scarlett
Updated over a week ago

Click through a drop-down menu

Written by Scarlett
Updated over a week ago

Scrape data from a pop-up

Written by Scarlett
Updated over a week ago

Select the correct HTML tag for web elements

Written by Scarlett
Updated over a week ago

Scrape data from inside a tab

Written by Scarlett
Updated over a week ago

Schedule tasks to run

Written by Scarlett
Updated over a week ago

Scrape a list of data

Written by Scarlett
Updated over a week ago

Standard Mode vs Boost Mode

Written by Octoparse
Updated over a week ago

How to delete a task group

Written by Octoparse
Updated over a week ago

Find Your Task ID

Written by Yina Huang
Updated over a week ago

Import and export tasks

Written by Scarlett
Updated over a week ago

Organize tasks using Filters (V8.1)

Written by Yina Huang
Updated over a week ago

Task Groups (V8.1)

Written by Scarlett
Updated over a week ago

Parent and child tasks

Written by Scarlett
Updated over a week ago

Tasks in Octoparse (V8.1)

Written by Octoparse
Updated over a week ago

Run task locally with Octoparse 8.5

Written by Yina Huang
Updated over a week ago

Set up IP Proxies

Written by Scarlett
Updated over a week ago

Resolve Captcha

Written by Scarlett
Updated over a week ago

Team collaboration web console (for Enterprise Plan)

Written by Yina Huang
Updated over a week ago

Incremental Extraction - Get updated data easily

Written by Yina Huang
Updated over a week ago

Get notified when a task finishes

Written by Yina Huang
Updated over a week ago

Switch IP Pools for your cloud runs

Written by Octoparse
Updated over a week ago

Anti-blocking solutions

Written by Yina Huang
Updated over a week ago

Exit loop

Written by Yina Huang
Updated over a week ago

Add custom User Agent

Written by Yina Huang
Updated over a week ago

Handling AJAX

Written by Scarlett
Updated over a week ago

Add triggers to an Extract Data

Written by Yina Huang
Updated over a week ago

Batch URL input

Written by Yina Huang
Updated over a week ago

Retry actions

Written by Yina Huang
Updated over a week ago

Back to the previous page

Written by Yina Huang
Updated over a week ago

Open in a new tab

Written by Yina Huang
Updated over a week ago

Close a pop-up

Written by Yina Huang
Updated over a week ago

Save and use cookies

Written by Scarlett
Updated over a week ago

Set up a page scroll

Written by Yina Huang
Updated over a week ago

Scrape and download files from websites

Written by Scarlett
Updated over a week ago

Intro to workflow & actions

Written by Scarlett
Updated over a week ago

Wait before action

Written by Kisad
Updated over a week ago

Click item

Written by Kisad
Updated over a week ago

Extract data

Written by Kisad
Updated over a week ago

Loop Item

Written by Scarlett
Updated over a week ago

Branch conditions

Written by Yina Huang
Updated over a week ago

Open page

Written by Yina Huang
Updated over a week ago

Enter text

Written by Yina Huang
Updated over a week ago

Hover over

Written by Kisad
Updated over a week ago

Dealing with pagination (clicking on a "Next" button)

Written by Yina Huang
Updated over a week ago

Dealing with pagination (with a "Load More" button)

Written by Yina Huang
Updated over a week ago

Dealing with pagination (no "Next" button)

Written by Yina Huang
Updated over a week ago

Dealing with pagination (infinite scroll)

Written by Yina Huang
Updated over a week ago

In what format can I download the extracted data?

Written by Kisad
Updated over a week ago

Backup local data to the Cloud

Written by Octoparse
Updated over a week ago

Export data to a database (automatic)

Written by Kisad
Updated over a week ago

Import and export a data field configuration

Written by Yina Huang
Updated over a week ago

Refine extracted data (replace content, add a prefix, etc.)

Written by Yina Huang
Updated over a week ago

Merge multiple rows of data into one

Written by Yina Huang
Updated over a week ago

Set up alternative XPath

Written by Yina Huang
Updated over a week ago

Add the original URL (before redirecting) along with the data scraped

Written by Yina Huang
Updated over a week ago

Convert the current time field to another time zone

Written by Yina Huang
Updated over a week ago

Remove duplicates

Written by Yina Huang
Updated over a week ago