> ## Documentation Index
> Fetch the complete documentation index at: https://www.octoparse.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Price monitoring with web scraping

> How retailers, brands, and marketplaces use web scraping to track competitor prices, normalize SKUs, detect changes, and trigger alerts.

Price monitoring turns web scraping into an operating system for retail decisions. A scraper collects product prices, availability, promotions, shipping terms, seller information, and ratings across competitors or marketplaces. The business then uses that data to adjust pricing, detect MAP violations, monitor stockouts, or understand market movement.

The scrape itself is only one piece. The real work is matching equivalent products, collecting at the right frequency, normalizing price signals, and alerting only when something meaningful changed.

## Who uses price monitoring

Common users include:

* **Retailers** tracking competitor prices and assortment.
* **Brands** checking marketplace sellers, unauthorized resellers, and MAP compliance.
* **Marketplaces** monitoring sellers, inventory, and category-level price dynamics.
* **Investment and research teams** using price movement as a demand or inflation signal.
* **Procurement teams** watching supplier catalog changes.

For example, a brand might monitor its top 500 SKUs across Amazon, Walmart, eBay, and specialty retailers. A marketplace seller might track one category every hour during a promotion window and daily outside that window.

## What to collect

A strong price record should include more than the visible price.

| Field                        | Why it matters                             |
| ---------------------------- | ------------------------------------------ |
| Product title                | Human-readable reference and matching clue |
| Product URL                  | Source provenance and refresh target       |
| SKU, ASIN, GTIN, UPC, MPN    | Product matching across sites              |
| Current price                | Core monitoring value                      |
| List price or original price | Discount and promotion analysis            |
| Shipping price               | Total landed cost                          |
| Availability or stock status | Price is meaningless if unavailable        |
| Seller name                  | Marketplace and reseller analysis          |
| Rating and review count      | Demand and trust context                   |
| Variant attributes           | Size, color, pack count, region            |
| Collected timestamp          | Change history and alerting                |

Amazon templates from scraping platforms often separate listing-page extraction from detail-page extraction. Listing pages are good for breadth: title, price, rating, review count, image, ASIN, and URL. Detail pages add depth: seller, description, feature bullets, specifications, best-seller rank, variants, stock signals, and reviews. That split is useful for price monitoring too: scan listings frequently, then refresh detail pages for the products that changed.

## SKU matching

Product matching is the hardest part of price monitoring. Different sites describe the same item differently.

Use exact identifiers when possible:

* ASIN for Amazon-specific workflows
* UPC, EAN, or GTIN for packaged goods
* MPN for manufacturer parts
* SKU for your own catalog

When identifiers are missing, combine fuzzy signals:

* Normalized title
* Brand
* Model number
* Pack count
* Size or volume
* Color or variant
* Image similarity
* Category path

Do not alert on a price difference until the match is reliable. A 2-pack and 6-pack can look similar but represent completely different unit economics.

## Scrape cadence

Frequency should match business value and site stability.

| Scenario                       | Typical cadence                       |
| ------------------------------ | ------------------------------------- |
| High-volume marketplace prices | Hourly or several times per day       |
| Brand MAP monitoring           | Daily                                 |
| Long-tail category research    | Weekly                                |
| Promotion or holiday campaigns | Higher frequency during event windows |
| Stock availability checks      | Hourly when inventory is volatile     |

More frequent scraping is not automatically better. It increases cost, block risk, and storage volume. Start with the business decision: if pricing changes are acted on daily, hourly scraping may only create noise.

## Change detection

A price monitoring system should distinguish events:

* Price dropped below a threshold.
* Competitor changed price by more than X percent.
* Seller changed on a marketplace listing.
* Product went out of stock or came back in stock.
* Promotion started or ended.
* Review count jumped or rating changed.

Store snapshots instead of overwriting rows. Historical data lets you calculate volatility, average discount depth, stockout duration, and promotion timing.

## Common pitfalls

* **Ignoring shipping.** A lower item price with higher shipping may not be cheaper.
* **Mixing variants.** Size, color, pack count, and subscription options can change the price.
* **Scraping only search results.** Listing pages may omit seller, stock, coupon, or variant details.
* **Over-alerting.** Small price movements can drown out meaningful changes.
* **Not tracking source time.** A price without a timestamp cannot support trend analysis.

## Template vs custom workflow

Templates are effective when the target is common and the desired fields match the standard output. Octoparse's Amazon scraper templates, for example, cover listing pages, product details, Prime listings, and reviews; Apify and Bright Data offer similar managed approaches for Amazon and e-commerce sources. These tools reduce the work around pagination, parsing, anti-blocking, and export.

Custom workflows are better when you need SKU matching across many retailers, custom alert logic, or downstream integration into pricing engines. A practical architecture is:

1. Collect source records.
2. Normalize and match products.
3. Store timestamped snapshots.
4. Compare against previous state.
5. Send only meaningful changes to alerts, BI, or repricing systems.

Price monitoring is successful when the scrape produces a reliable decision, not just a spreadsheet of prices.