# Octoparse Docs

> Developer documentation for Octoparse MCP Server and OpenAPI integrations.

## Docs

- [Octoparse documentation](https://www.octoparse.com/docs/en/overview.md): No-code scraping, cloud extraction, AI integrations, OpenAPI automation, and practical web scraping guides.
- [July 2026 release notes](https://www.octoparse.com/docs/en/changelog/july-2026.md): July 2026 Octoparse CLI updates improve blocked-page detection, candidate selection, row-limit completion, and reliable process exit.
- [April 2026 release notes](https://www.octoparse.com/docs/en/changelog/april-2026.md): April 2026 updates and improvements to Octoparse integrations.
- [Octoparse academy](https://www.octoparse.com/docs/en/academy/index.md): Web scraping explained — concepts, mechanics, use cases, and site-specific guides for the no-code era.
- [What is web scraping?](https://www.octoparse.com/docs/en/academy/what-is-web-scraping.md): Web scraping is the automated extraction of structured data from websites. Learn how it works, where it's used, and how it differs from APIs and manual collection.
- [What is no-code web scraping?](https://www.octoparse.com/docs/en/academy/what-is-no-code-web-scraping.md): No-code web scraping lets non-developers extract data from websites visually — without writing Python, XPath, or HTTP code. Learn the model, capabilities, and limits.
- [What is AI web scraping?](https://www.octoparse.com/docs/en/academy/what-is-ai-web-scraping.md): AI web scraping uses AI to detect page structure, generate matching rules, and extract data from raw HTML — more resilient than rule-based scrapers.
- [AI vs traditional web scraping](https://www.octoparse.com/docs/en/academy/ai-vs-traditional-scraping.md): When AI-driven scraping beats selector-based scraping, when it doesn't, and how to combine the two. Cost, accuracy, maintenance, and reliability compared.
- [Web scraping vs web crawling](https://www.octoparse.com/docs/en/academy/web-scraping-vs-crawling.md): Scraping and crawling are often confused but solve different problems. Learn the technical and intent-level differences, and when to use each.
- [Is web scraping legal?](https://www.octoparse.com/docs/en/academy/is-web-scraping-legal.md): Web scraping legality depends on what you scrape, how, and where. An overview of public data, ToS, copyright, GDPR/CCPA, court cases, and how to scrape compliantly.
- [Anatomy of a web scraper](https://www.octoparse.com/docs/en/academy/anatomy-of-a-web-scraper.md): Every web scraper runs the same pipeline: fetch, render, locate, extract, navigate, and store. A map of the stages and how they fit together.
- [Scraping JavaScript-rendered pages](https://www.octoparse.com/docs/en/academy/scrape-javascript-pages.md): Modern sites render content client-side with React, Vue, or vanilla JS. Why basic HTTP scrapers fail, and three fixes: rendering in a real browser, API interception, and SSR detection.
- [The browser runtime landscape](https://www.octoparse.com/docs/en/academy/browser-runtime-landscape.md): A field guide to the browser runtimes used for scraping — Puppeteer, Playwright, Selenium, cloud APIs, and Octoparse as the headed alternative.
- [Headed vs headless browsers](https://www.octoparse.com/docs/en/academy/headed-vs-headless-browsers.md): Headless browsers dominate the scraping ecosystem, but Octoparse and similar platforms run headed by design. Why the choice matters, and which fits when.
- [How to handle pagination](https://www.octoparse.com/docs/en/academy/handle-pagination.md): Learn how scrapers move beyond page one: numbered pages, next links, infinite scroll, load-more buttons, API offsets, and cursor-based pagination.
- [Scraping behind login walls](https://www.octoparse.com/docs/en/academy/scraping-login-walls.md): How scrapers handle authenticated pages with cookies, session reuse, browser-based login, MFA limits, and account-safe operating practices.
- [XPath & CSS selectors](https://www.octoparse.com/docs/en/academy/xpath-css-selectors.md): CSS selectors and XPath both locate elements on a page, but they break differently. How each works, when to pick which, and how to write selectors that hold up.
- [Refining data with regex](https://www.octoparse.com/docs/en/academy/refining-data-with-regex.md): Raw scraped values arrive messy — prices with symbols, phones in three formats, dates that vary by page. The regex patterns that clean them, and how Octoparse generates them with AI.
- [Cloud web scraping explained](https://www.octoparse.com/docs/en/academy/cloud-web-scraping.md): Why web scrapers move to the cloud: unattended runs, subtask parallelism, scheduling, resource orchestration, and network infrastructure.
- [Browser fingerprinting](https://www.octoparse.com/docs/en/academy/browser-fingerprinting.md): Anti-bot systems identify scrapers by the combined signature of canvas, WebGL, fonts, UA, and dozens of other signals. What's tracked, why scrapers leak, and how to manage the fingerprint.
- [Human-like scraping](https://www.octoparse.com/docs/en/academy/human-like-scraping.md): Even a clean fingerprint gets a scraper flagged if the mouse moves in straight lines. The behavioral tells that mark a scraper as a bot, and how to remove them.
- [Bypassing CAPTCHA & Cloudflare](https://www.octoparse.com/docs/en/academy/captcha-and-cloudflare.md): How CAPTCHA challenges and Cloudflare-style bot defenses work, why they appear during scraping, and which layers help reduce or resolve them.
- [Rotating proxies for web scraping](https://www.octoparse.com/docs/en/academy/rotating-proxies.md): Why scrapers use proxy rotation, how datacenter, residential, ISP, and mobile proxies differ, and how to choose rotation strategies that match the target site.
- [Lead generation with web scraping](https://www.octoparse.com/docs/en/academy/lead-generation.md): How sales and marketing teams use web scraping to build targeted lead lists: sources, fields, enrichment, validation, and compliance safeguards.
- [Price monitoring with web scraping](https://www.octoparse.com/docs/en/academy/price-monitoring.md): How retailers, brands, and marketplaces use web scraping to track competitor prices, normalize SKUs, detect changes, and trigger alerts.
- [Real estate data extraction](https://www.octoparse.com/docs/en/academy/real-estate-data.md): How real estate teams collect listing, rental, sold, agent, and neighborhood data from public portals while handling freshness, duplicates, and compliance.
- [E-commerce data collection](https://www.octoparse.com/docs/en/academy/ecommerce-data.md): How teams collect product catalogs, prices, reviews, ratings, seller data, and inventory signals from e-commerce sites and marketplaces.
- [Social media data mining](https://www.octoparse.com/docs/en/academy/social-media-data.md): How teams collect public social posts, profiles, engagement, and trend signals while respecting platform limits, privacy, and API alternatives.
- [Data collection for AI and LLMs](https://www.octoparse.com/docs/en/academy/ai-data-collection.md): How to collect data for AI and LLM training, fine-tuning, and RAG with web scraping: choosing sources, the fields to keep, the collection flow, and quality, license, and compliance design.
- [Data collection for market and competitive research](https://www.octoparse.com/docs/en/academy/market-research.md): How to collect data for market and competitive research with web scraping: the types of data to gather, choosing sources, designing point-in-time monitoring, extending to competitor analysis, and what to watch for.
- [Data collection for review and sentiment analysis](https://www.octoparse.com/docs/en/academy/review-sentiment-analysis.md): How to collect review data for sentiment analysis with web scraping: the data to gather, choosing sources, designing collection, extending to analysis, and copyright and personal-data considerations.
- [How to scrape Amazon](https://www.octoparse.com/docs/en/academy/scrape-amazon.md): A practical guide to extracting Amazon product data: search results, product pages, reviews, variants, prices, seller data, and anti-bot considerations.
- [How to scrape LinkedIn](https://www.octoparse.com/docs/en/academy/scrape-linkedin.md): What is technically and operationally involved in collecting public LinkedIn profiles, company pages, jobs, and posts, with legal and ethical safeguards.
- [How to scrape Google Maps](https://www.octoparse.com/docs/en/academy/scrape-google-maps.md): How to extract local business listings from Google Maps: search inputs, listing fields, place details, reviews, map splitting, and lead enrichment.
- [How to scrape Yelp](https://www.octoparse.com/docs/en/academy/scrape-yelp.md): How to extract Yelp business listings, profiles, reviews, ratings, categories, and contact signals for local research and review analysis.
- [How to scrape Tabelog](https://www.octoparse.com/docs/en/academy/scrape-tabelog.md): Scrape Tabelog, Japan's largest restaurant review site: the data you can collect, how to navigate search and detail pages, and how to handle JavaScript-rendered content and anti-bot controls.
- [How to scrape Rakuten Ichiba](https://www.octoparse.com/docs/en/academy/scrape-rakuten.md): Scrape Rakuten Ichiba, Japan's largest marketplace: the data fields you can collect, how to navigate search to product and review pages, handling JavaScript-loaded content and pagination, and how to collect it with Octoparse.
- [What is Octoparse?](https://www.octoparse.com/docs/en/platform/what-is-octoparse.md): Octoparse is a no-code web data extraction platform built for analysts, growth teams, and operations people who need structured data from websites — without writing scrapers from scratch.
- [Competitor price and stock monitoring](https://www.octoparse.com/docs/en/solutions/competitor-price-stock-monitoring.md): Build a competitor price and stock monitoring workflow in Octoparse, from selecting a template to scheduling runs and syncing results to Google Sheets.
- [Refresh a local business directory](https://www.octoparse.com/docs/en/solutions/local-business-directory-refresh.md): Use Octoparse to refresh a local business directory on a schedule, then deliver deduplicated, filterable records to Google Sheets.
- [Octoparse OpenAPI](https://www.octoparse.com/docs/en/api-reference/index.md): Octoparse OpenAPI reference for authentication, task management, cloud extraction, and data export.
- [Search Templates](https://www.octoparse.com/docs/en/api-reference/agenttools-api/search-templates.md): Search Octoparse scraping templates and inspect their input schema before running executeTask.
- [Execute Task](https://www.octoparse.com/docs/en/api-reference/agenttools-api/execute-task.md): Create and start a scraping task from an AgentTools template.
- [Export Data](https://www.octoparse.com/docs/en/api-reference/agenttools-api/export-data.md): Check export status and retrieve export metadata for an AgentTools task.
- [Search Tasks](https://www.octoparse.com/docs/en/api-reference/agenttools-api/search-tasks.md): Search existing Octoparse tasks before starting, stopping, or exporting them through AgentTools.
- [Start Or Stop Task](https://www.octoparse.com/docs/en/api-reference/agenttools-api/start-or-stop-task.md): Start or stop an existing Octoparse task through AgentTools.
- [Obtain a New Token](https://www.octoparse.com/docs/api-reference/access-token/obtain-a-new-token.md): **Required plan:** All users.
- [Refresh Token](https://www.octoparse.com/docs/en/api-reference/access-token/refresh-token.md): **Required plan:** All users.
- [Get Task Group Information](https://www.octoparse.com/docs/api-reference/task-group/get-task-group-information.md): **Required plan:** Standard, Professional, or Enterprise.
- [Search Task](https://www.octoparse.com/docs/api-reference/task/search-task.md): **Required plan:** Standard, Professional, or Enterprise.
- [Get Task Performance Analytics](https://www.octoparse.com/docs/api-reference/task/get-task-performance-analytics.md): **Required plan:** Standard, Professional, or Enterprise.
- [Get Action Parameters](https://www.octoparse.com/docs/api-reference/task/get-action-parameters.md): **Required plan:** Professional or Enterprise.
- [Update Task Parameters](https://www.octoparse.com/docs/api-reference/task/update-task-parameters.md): **Required plan:** Professional or Enterprise.
- [Duplicate Task](https://www.octoparse.com/docs/api-reference/task/duplicate-task.md): **Required plan:** Standard, Professional, or Enterprise.
- [Move Task](https://www.octoparse.com/docs/api-reference/task/move-task.md): **Required plan:** Standard, Professional, or Enterprise.
- [Update Action Parameters](https://www.octoparse.com/docs/api-reference/task/update-action-parameters.md): **Required plan:** Professional or Enterprise.
- [Update Loop Item List](https://www.octoparse.com/docs/api-reference/task/update-loop-item-list.md): **Required plan:** Professional or Enterprise.
- [Update Task URLs](https://www.octoparse.com/docs/api-reference/task/update-task-urls.md): **Required plan:** Professional or Enterprise.
- [Start Task](https://www.octoparse.com/docs/api-reference/cloud-extraction/start-task.md): **Required plan:** Professional or Enterprise.
- [Stop Task](https://www.octoparse.com/docs/api-reference/cloud-extraction/stop-task.md): **Required plan:** Professional or Enterprise.
- [Get Task Status](https://www.octoparse.com/docs/api-reference/cloud-extraction/get-task-status.md): **Required plan:** Professional or Enterprise.
- [Get Task Status V2](https://www.octoparse.com/docs/api-reference/cloud-extraction/get-task-status-v2.md): **Required plan:** Professional or Enterprise.
- [Get Subtask Status](https://www.octoparse.com/docs/api-reference/cloud-extraction/get-subtask-status.md): **Required plan:** Professional or Enterprise.
- [Start Subtasks](https://www.octoparse.com/docs/api-reference/cloud-extraction/start-subtasks.md): **Required plan:** Professional or Enterprise.
- [Stop Subtasks](https://www.octoparse.com/docs/api-reference/cloud-extraction/stop-subtasks.md): **Required plan:** Professional or Enterprise.
- [Get Non-Exported Data](https://www.octoparse.com/docs/api-reference/data/get-non-exported-data.md): **Required plan:** Standard, Professional, or Enterprise.
- [Mark Data as Exported](https://www.octoparse.com/docs/api-reference/data/mark-data-as-exported.md): **Required plan:** Standard, Professional, or Enterprise.
- [Get Data by Offset](https://www.octoparse.com/docs/api-reference/data/get-data-by-offset.md): **Required plan:** Standard, Professional, or Enterprise.
- [Remove Data](https://www.octoparse.com/docs/api-reference/data/remove-data.md): **Required plan:** Standard, Professional, or Enterprise.
- [Get Data From a Designated Batch by Offset](https://www.octoparse.com/docs/api-reference/data/get-data-from-a-designated-batch-by-offset.md): **Required plan:** Standard, Professional, or Enterprise.
- [Octoparse CLI](https://www.octoparse.com/docs/en/cli.md): Use Octoparse CLI to create, run, manage, schedule, inspect, automate, and export Octoparse tasks in local or cloud environments.
- [Installation](https://www.octoparse.com/docs/en/cli/quick-start/installation.md): Install Octoparse CLI with npm, check Node.js and platform requirements, and verify the local engine, Chrome, and user-browser readiness.
- [Get an API key and log in](https://www.octoparse.com/docs/en/cli/quick-start/get-api-key-and-log-in.md): Authenticate Octoparse CLI with OAuth or an API key. Use an environment variable or stdin for CI and automated environments.
- [Run your first Octoparse CLI task](https://www.octoparse.com/docs/en/cli/quick-start/run-your-first-task.md): Find and validate an Octoparse task, run a limited local extraction, inspect collected rows, and export the result with a short CLI workflow.
- [Create tasks from a URL](https://www.octoparse.com/docs/en/cli/guides/detect.md): Use octoparse detect to inspect a URL, select a data region, and generate a local task file. Supports automatic, manual, and AI agent workflows.
- [Create tasks from templates](https://www.octoparse.com/docs/en/cli/guides/templates.md): Search the Octoparse template catalog, inspect normalized parameters, and create, preview, or update template-based tasks from the CLI.
- [Manage tasks and task groups](https://www.octoparse.com/docs/en/cli/guides/tasks-and-groups.md): List, inspect, copy, rename, move, delete, and validate Octoparse tasks, then create and manage task groups from the command line.
- [Choose a browser mode](https://www.octoparse.com/docs/en/cli/guides/browser-modes.md): Choose independent Chrome or a signed-in Chrome or Edge profile, configure selection priority, and verify Octoparse CLI browser readiness.
- [Run tasks locally](https://www.octoparse.com/docs/en/cli/guides/local-runs.md): Run Octoparse tasks locally, choose a browser, stream JSONL events, detach execution, control active runs, inspect history, and export results.
- [Run and schedule cloud tasks](https://www.octoparse.com/docs/en/cli/guides/cloud-runs-and-schedules.md): Start, stop, inspect, and schedule Octoparse cloud extraction tasks from the CLI, including history, frequency types, and confirmation controls.
- [Inspect and export data](https://www.octoparse.com/docs/en/cli/guides/data.md): Inspect local or cloud extraction history, count and preview rows, and export Octoparse task data as XLSX, CSV, HTML, JSON, or XML.
- [Automate Octoparse CLI](https://www.octoparse.com/docs/en/cli/guides/automation.md): Use Octoparse CLI in CI, scripts, and AI agents with capabilities discovery, JSON output, environment credentials, and exit codes.
- [Output and exit codes](https://www.octoparse.com/docs/en/cli/reference/output-and-exit-codes.md): Understand Octoparse CLI JSON output, JSONL event streams, stdout, stderr, exit codes, and JSONL event types for automation.
- [Octoparse CLI command reference](https://www.octoparse.com/docs/en/cli/reference/command-cheatsheet.md): Quick syntax index for Octoparse CLI authentication, browser, task, template, detect, local run, cloud schedule, automation, and data commands.
- [Troubleshooting Octoparse CLI](https://www.octoparse.com/docs/en/cli/reference/troubleshooting.md): Fix Octoparse CLI authentication, Chrome, browser profile, task execution, blocked-page detection, Linux arm64, and data export errors.
- [Octoparse MCP Server](https://www.octoparse.com/docs/en/mcp/index.md): Overview and quick start for the Octoparse MCP Server.
- [Rate limits](https://www.octoparse.com/docs/en/mcp/rate-limits.md): Understand request limits and how to handle retry logic with response headers.
- [Example workflow](https://www.octoparse.com/docs/en/mcp/workflow.md): A complete example — from finding a template to exporting results.
- [Troubleshooting](https://www.octoparse.com/docs/en/mcp/troubleshooting.md): Troubleshoot common Octoparse MCP Server setup, authentication, task execution, and export issues.
- [FAQ](https://www.octoparse.com/docs/en/mcp/faq.md): Common questions about MCP tools, task execution, and account limits.
- [search_templates](https://www.octoparse.com/docs/en/mcp/search-templates.md): Search for pre-built Octoparse scraping templates.
- [execute_task](https://www.octoparse.com/docs/en/mcp/execute-task.md): Run a scraping template and retrieve results.
- [export_data](https://www.octoparse.com/docs/en/mcp/export-data.md): Export completed task data as JSON or CSV.
- [search_tasks](https://www.octoparse.com/docs/en/mcp/search-tasks.md): List and search existing tasks.
- [start_or_stop_task](https://www.octoparse.com/docs/en/mcp/start-or-stop-task.md): Start or stop a cloud task by ID.
- [redeem_coupon_code](https://www.octoparse.com/docs/en/mcp/redeem-coupon-code.md): Redeem a promotional or resource coupon code.

## OpenAPI Specs

- [refresh-token.openapi](https://www.octoparse.com/docs/ko/api/refresh-token.openapi.json)
- [openapi](https://www.octoparse.com/docs/openapi.json)
- [openapi_en](https://www.octoparse.com/docs/openapi_en.json)