Scenarios it handles
Extract repeated lists
Extract repeated items from search results, directories, product grids, or tables.
Drill into detail pages
Click into each item, collect additional fields, then return to the list.
Navigate across pages
Move across pages, load more results, or scroll to reveal dynamic content.
Customize field values
Select fields manually and refine extracted values before export.
- No suitable template exists
- Auto-detect misses fields or page actions
- The workflow requires detail pages
- The website uses custom pagination or infinite scroll
- You need to handle popups, menus, tabs, or login steps
- You need field-level cleanup before export
Basic workflow
1
Open the page
Start with the URL that contains the data you want to collect.
2
Select elements
Click the data fields, buttons, links, or list items that define the extraction workflow.
3
Choose actions
Add actions such as extract data, click, loop through items, paginate, scroll, or wait.
4
Review the workflow
Check the action sequence and make sure the task follows the intended page path.
5
Run a test
Execute a small sample and review the output before running the full task.
Common actions
Editing selectors manually
When the default element selection does not capture the right data, you can edit the underlying XPath directly. This is useful when:- The auto-generated selector is too broad or too narrow
- You need to target a specific attribute (e.g.
href,src,data-price) instead of visible text - The page structure changes slightly between items and the default selector misses some rows
Troubleshooting
Best practices
- Start with a small sample before running the full task.
- Use clear field names.
- Check whether values are captured from visible text, links, images, attributes, or HTML.
- Add waits when content loads dynamically.
- Keep the workflow as simple as possible.
- Re-test after the target website changes.
The no-code builder creates a repeatable workflow based on the website structure. If the website changes significantly, you may need to adjust the task.
Related pages
Templates
Start with a prebuilt workflow for common websites.
Auto-detect
Let Octoparse scan a page and generate a starting workflow automatically.
Refine data
Clean and reformat extracted fields before export.