logo
EN

Web Scraping

Dig deeper into data extraction, see web scraping scenarios in particular industries, and learn how to process scraped data.
283 posts

Dynamic Web Scraping: Browser-Based Scraping vs. HTTP Requests

avatarAnsel Barrett
Learn when browser-based scraping fits a dynamic website, when HTTP requests are enough, and how to use Octoparse to test and repeat a visual extraction workflow.
2026-11-09T18:55:19+00:00 · 9 min read

Octoparse API: A Beginner-Friendly Guide to Connecting Web Data

avatarAnsel Barrett
Learn how to use the Octoparse API with Data Hub App API, OpenAPI, AgentTools API, MCP, and CLI. Includes a tested 16-record workflow and first-run steps.
2026-11-09T18:44:56+00:00 · 7 min read

Cloud Web Scraping API: Automate Data Collection and Integration with Octoparse

avatarAbigail Jones
Learn how cloud web scraping APIs connect Octoparse data collection with Amazon price monitoring, databases, dashboards, and recurring workflows.
2026-11-06T19:17:03+00:00 · 9 min read

Web Scraping Proxy Not Working? Diagnose 403/429 Errors with Octoparse

avatarAnsel Barrett
Proxy not working? Diagnose 403, 429, login, country, cloud, and empty-result issues. Follow Octoparse steps to test a small sample and scale with confidence.
2026-11-06T18:18:44+00:00 · 11 min read

How to Scrape Shopee Data in 2026: Products, Prices and Sales

avatarAbigail Jones
Shopee Brazil now asks visitors to log in, and product pages round sold counts. Here's how to scrape Shopee products, prices and sales in 2026.
2026-11-06T00:00:00+00:00 · 7 min read

AI Browser Agents vs Web Scrapers: We Timed 4 Agents

avatarBertram Xiao
AI browser agent vs web scraper speed test: we timed Codex, Claude, Antigravity and Jev on one Google Flights search. See results and when to use each.
2026-10-29T12:10:17+00:00 · 26 min read

Apify Alternatives: 9 Best Web Scraping Tools (2026)

avatarBertram Xiao
Looking for an Apify alternative? Compare the 9 best web scraping tools of 2026 on real pricing, no-code and API access, and anti-bot reliability.
2026-09-30T11:52:46+00:00 · 17 min read

How to Scrape Google Jobs: Fields, Tools, and Validation Steps

avatarAbigail Jones
Learn how to scrape Google Jobs responsibly, review a 38-row Chicago test, validate fields, handle duplicates, and test before scheduling.
2026-09-28T22:35:34+00:00 · 10 min read

6 Best AI Web Scrapers in 2026: Compared by Price, AI Capability, and Data Delivery

avatarAbigail Jones
Compare 6 AI web scrapers in 2026 by price, AI capability, and data delivery, including Octoparse, Diffbot, Firecrawl, Thunderbit, and more.
2026-09-28T17:33:35+00:00 · 10 min read

Firecrawl Alternatives: 7 Tools Compared by Use Case

avatarAnsel Barrett
Compare 7 Firecrawl alternatives by API, no-code, open-source, managed-data, MCP, pricing signals, and workload fit before choosing a production stack.
2026-09-27T19:52:20+00:00 · 12 min read

SEO Ranking API: Scrape Keyword Rankings and SERPs

avatarAnsel Barrett
Compare keyword ranking APIs and SERP scraping: what an SEO ranking API returns, when to collect raw results, and how to track positions by location.
2026-09-23T10:25:03+00:00 · 11 min read

Etsy Scraper: 15-Listing Test at $0.25/1,000 Rows

avatarAbigail Jones
We tested Octoparse’s Etsy URL template on 15 listings: 15/15 inputs completed, 13 returned full data, and the template page showed $0.25 per 1,000 lines.
2026-09-22T08:00:00+00:00 · 8 min read