Skip to main content
Cloud Agent builds a dedicated scraper from a request you write in your own words, in any language, and runs it on Octoparse Cloud. Once it’s built, it runs with your computer off, and from Standard it can run on a schedule around the clock. You don’t write code or set up servers, and anyone on any plan can build and run one.
Cloud Agent is in Beta.

​
When to use Cloud Agent

Cloud Agent is a good fit when:
  • No ready-made template covers the site or the fields you need
  • You need specific fields, filters, or inputs, such as a list of keywords or locations
  • You want the data collected again on a schedule, or in large batches
  • You want the job to keep running without your computer on

​
How Cloud Agent collects data

Cloud Agent explores the site, writes the collection rules, and tests them before it hands the scraper over. Every run then follows those rules in a browser on Octoparse Cloud. See How AI Assistant works.
The more detail you give up front, the less you’ll need to adjust later. See Describe your data.

​
Build a scraper with Cloud Agent

1

Describe what you need

Start a chat in AI Assistant and describe the site and the data. AI Assistant recommends Cloud Agent when it suits your request. To use it from the start, pick Cloud Agent in the mode selector when you start a new chat.
2

Let Cloud Agent build it

Building takes a while, because Cloud Agent tests the scraper before handing it over. You can leave the page: you’ll get an email when it’s done.
3

Review the result

When the scraper is ready, AI Assistant shows its fields and inputs. Select Configure input and run to set the inputs and start a run, Schedule Runs to run it regularly, or View task to open the task.

​
What you see while it builds

While it works:
  • The chat shows each step it takes under Working.
  • The Agent’s computer panel shows its Agent to-dos list and a Live view of the site it’s working on.
  • When it’s done, switch to Output in the panel to see the result.

​
Run it on Octoparse Cloud

A Cloud Agent scraper runs on Octoparse Cloud, not on your computer:
  • No servers, browsers, or setup on your side
  • Runs with your computer off, and on a schedule from Standard
We’re extending Octoparse Cloud with more anti-blocking capabilities, so Cloud Agent can handle more sites. Every plan can build a scraper and run it on Octoparse Cloud:
  • On Free and Basic, start each run yourself with Configure input and run. Runs count toward your monthly rows, up to 100 rows per run on Free. Scheduled runs aren’t available.
  • On Standard or above, the scraper starts its first run automatically once it’s built. There’s no row limit, and you can put it on a schedule.

​
Change and reuse your scraper

The scraper is saved as a task. Use Edit input to change its inputs, such as keywords or URLs, Resume Chat to change what it collects, and Schedule Runs to run it regularly. See Manage AI tasks.

​
Limits

  • Cloud Agent scrapers run on Octoparse Cloud only. There’s no option to run them on your computer.
  • Sites that need you to sign in aren’t supported. Use Browser Use instead.
  • Heavily protected sites may block the scraper.
  • If Cloud Agent can’t build the scraper, see Troubleshooting.

How AI Assistant works

How AI Assistant picks between templates, Browser Use, Cloud Agent, and Auto-detect.

Cloud schedules

Run cloud tasks at a fixed time or on a repeating interval.

Export formats and destinations

Send the data to files, databases, and cloud storage.