Skip to main content

​
Competitor price and stock monitoring with Octoparse

Use this workflow when you need a repeatable view of selected competitors’ product prices, availability, or promotions. In Octoparse, the practical path is to start with a template or task, validate the fields, schedule recurring runs, and deliver the output to Google Sheets for review. The result is a maintained dataset for monitoring—not a one-time list of prices.

​
What this workflow helps you do

  • Track selected product pages or listings at a cadence that matches your business need.
  • Collect fields such as product name, URL, current price, list price, availability, seller, and promotion text when they are available on the target page.
  • Keep recurring output in a shared Google Sheet.
  • Review missing fields, duplicates, and failed runs before relying on the data.
This workflow is designed for publicly accessible product information. The fields available and the task’s stability depend on the target website, its page structure, and its access requirements.

​
Before you build the task

Define the decision the data must support before selecting fields or a run frequency. Use stable product identifiers or URLs whenever possible. Product titles and variants can change, so they are weaker matching keys on their own.

​
Build the workflow

1

Find a starting template or create a task

Search the template library for the target website or data type. If it does not include the required page flow or fields, use Auto-detect or the no-code builder to create or adjust the task.
2

Confirm the output fields

Keep the initial field set focused: product name, product URL, price, stock or availability, and any seller or promotion field needed for the decision. Run a small sample and check the output against the source pages.
3

Test before scheduling

Confirm that pagination, detail-page fields, variants, and any required login or interaction work as expected. Test the task manually before enabling unattended runs.
4

Set a recurring schedule

Configure a schedule only after the task is stable. Start with the lowest frequency that supports the business decision, then monitor the first runs for errors or overlapping jobs.
5

Sync the output to Google Sheets

Connect a destination sheet and configure Google Sheets data sync. Keep the Octoparse-controlled raw output separate from tabs used for formulas, charts, or change review.
6

Review and maintain the workflow

Check run history, logs, row counts, duplicates, and missing values. Update the task when a target page changes or when the output no longer supports the decision.

​
Follow the detailed tutorial

How to track or monitor price with Octoparse

Follow the Help Center tutorial for the click-by-click setup of a pricing task, scheduled runs, and automatic data export.

​
Suggested sheet layout

Use one tab for synchronized output and a separate analysis tab. This reduces the risk that manual edits interfere with later exports.
Start with a small, representative set of products. Confirm the first few scheduled runs before expanding the product list or increasing the run frequency.

​
When this workflow needs adjustment

Use a different or customized task when:
  • The required field is not present in the template output.
  • The site uses dynamic rendering, login, or a page flow that the template does not cover.
  • Product variants, shipping, coupons, or seller changes require additional logic.
  • The website changes its layout and the output is no longer reliable.
Do not treat a successful first run as proof that a recurring workflow will remain stable. Review early scheduled runs and use logs to investigate failures or missing data.

Templates

Start with a prebuilt workflow for a supported website or data type.

Schedules

Run a stable task automatically at a defined time or interval.

Google Sheets data sync

Keep a shared sheet updated with recurring extraction output.

Price monitoring with web scraping

Learn the data design and business context behind price monitoring.