Overview
The APIFY Node in Scade allows you to extract data from virtually any website using APIFY, a powerful web scraping and automation service. With this integration, you can fetch structured data from social media, e-commerce platforms, news sites, and more, then use it in your workflows for analysis, automation, or content generation.
What is APIFY?
APIFY is a cloud-based platform that provides tools for web scraping, data extraction, and browser automation. It enables users to run Actors—pre-configured web scrapers and automation scripts—to collect structured data from the internet.
APIFY is widely used for:
Scraping social media data (e.g., extracting tweets, LinkedIn posts, or Instagram captions)
Monitoring e-commerce prices
Collecting business information
Gathering news articles
Extracting structured data from any website
Using the APIFY node in Scade
Create an APIFY account and get an API key
Sign up at Apify.com.
Navigate to Profile Settings.
Open the Integrations section.
Copy your API Key.
Add APIFY node in Scade
Create a new workflow in Scade.
Add an APIFY node (search for it or find it in the Popular category).
Add APIFY Credentials:
Paste your API Key into the node’s credential settings.
Choose an APIFY Actor (Scraper)
Open the APIFY Actor catalog.
Select a suitable Actor (a scraper for your specific data needs). Actors with Pay for Usage billing are recommended.
Copy the Actor ID.
Paste the Actor ID into the APIFY Node Input field in Scade.
Configure the Scraper
Open the chosen Actor’s configuration panel in APIFY.
Adjust the scraping settings as needed.
Switch to JSON format.
Copy the JSON configuration.
Paste this config into the APIFY Node in Scade.
Refine and filter output
You can add extra parameters in Scade to clean up the output.
Filtering options are available directly within the node.
Example use case: Scraping and analyzing Twitter (X) data
Imagine you want to summarize a Twitter creator’s activity, analyzing the topics they cover based on their latest 100 tweets.
Use an APIFY Twitter Scraper Actor.
Configure it to extract 100 tweets from a chosen profile.
Send the scraped data to ChatGPT or Claude Node for analysis.
Generate insights such as trending topics, sentiment analysis, or engagement patterns.
The APIFY Node on Scade allows seamless web scraping and automation within your workflows. Whether you’re gathering social media data, tracking market trends, or extracting structured information, this integration makes it easy to collect and process web-based data efficiently.