# Startpage Scraper

Extract search results by keyword from Startpage, fields include keyword, title, result link, desecription, etc.

- Template page: [https://www.octoparse.com/template/startpage-scraper](https://www.octoparse.com/template/startpage-scraper)
- Categories: Search Engine
- Status: `PUBLISHED`
- Run mode: `BOTH`

## Pricing

Free.

## What is an Octoparse template?

An Octoparse template is a ready-to-use scraping workflow with predefined inputs and structured outputs. Use the exact parameter keys below; do not invent parameters.

## Overview

This ready-to-use template collects structured data from search-results pages.

## Output

The current workflow extracts 4 fields, including `Description`, `Keyword`, `Result_link`, `Title`.

## Use Cases

- Use structured results for research, comparison, and monitoring.
- Collect rows without building the extraction workflow from scratch.
- Combine results with other templates for downstream enrichment.
- Review a representative result before starting a large batch.

## Why Octoparse

- **No coding required:** complete Keyword (up to 100 per run) and start the template in local or cloud mode.
- **Flexible export:** review and export results as CSV, Excel, or JSON.

## Input

### Keyword (up to 100 per run)

Required. Enter a list of keywords for searching with Startpage. Constraints: minItems=1; maxItems=100; items.minLength=1; items.maxLength=5000.

## How to Use

### Startpage Scraper Usage Guide

This template collects search-result records from [Startpage](https://www.startpage.com/). It returns **Title**, **Result_link**, **Description**, and **Keyword** for each result.

**Pricing:** Free of charge (Octoparse plan or resource limits may apply).

#### Input

Complete the **Keyword** field (required). Enter a list of keywords (up to **100 entries per run**).

#### How to Use

1. Open Startpage Scraper and click **Try it!**.
2. Fill in the **Keyword** field (up to 100 entries).
3. Choose a local or cloud run in Octoparse and start the task.
4. After the run, review the output fields, then export in your preferred format.

#### Output Fields

- `Keyword`
- `Title`
- `Result_link`
- `Description`

#### Tips

- Start with a focused keyword to make the first run easy to review.
- Keep `Keyword` in the export so every row can be traced back to its input.

## Notes

If the template doesn't work well, feel free to report it to us with the parameters you test We also provide managed template/crawler customization services. If you're interested, please contact template@octoparse.com with your project details

## Limitations

Results depend on what the source site exposes at run time. Fields may be empty when a source page does not provide a value. The template enforces the input limits shown above.

## Tips

Use specific, valid inputs and review a representative result before starting a large batch. Remove duplicate inputs when repeated records are not needed.

## FAQ

### What do I need to enter?

Use the exact inputs and limits listed above.

### What data does this template return?

See Output Schema below; availability can vary by source record.

### How is usage billed?

See the Pricing section above for current pricing and billing details.

## Related Templates

- [eBay Listing Page Scraper (by keyword)](https://www.octoparse.com/template/ebay-product-list-scraper-by-keyword)
- [eBay Scraper](https://www.octoparse.com/template/ebay-scraper)
- [Google Search Scraper](https://www.octoparse.com/template/google-search-scraper)
- [Google Maps Listings Scraper (by Keywords)](https://www.octoparse.com/template/google-maps-scraper-listing-page-by-keyword)

## Input Schema

```json
{
  "title": "Startpage Scraper input",
  "description": "Input parameters configured for the current published template version.",
  "type": "object",
  "schemaVersion": 1,
  "additionalProperties": false,
  "properties": {
    "keyword": {
      "title": "Keyword (up to 100 per run)",
      "description": "Enter a list of keywords for searching with Startpage.",
      "type": "array",
      "items": {
        "type": "string",
        "minLength": 1,
        "maxLength": 5000
      },
      "minItems": 1,
      "maxItems": 100,
      "x-octoparse": {
        "apiEnabled": true
      }
    }
  },
  "required": [
    "keyword"
  ]
}
```

## Input JSON Example

Example 1

```json
{
  "keyword": [
    "hvac contractor Jacksonville FL",
    "heating and cooling Jacksonville FL",
    "hvac contractor Bunnell FL",
    "heating and cooling Bunnell FL",
    "hvac contractor Port St. Lucie FL"
  ]
}
```

Example 2

```json
{
  "keyword": [
    "hvac contractor Jackson MS",
    "heating and cooling Jackson MS",
    "hvac contractor Tupelo MS",
    "heating and cooling Tupelo MS",
    "hvac contractor Olive Branch MS"
  ]
}
```

Example 3

```json
{
  "keyword": [
    "heating and cooling Atlanta GA"
  ]
}
```


## Output Schema

```json
{
  "schemaVersion": 1,
  "type": "object",
  "properties": {
    "Description": {
      "type": "string",
      "description": ""
    },
    "Keyword": {
      "type": "string",
      "description": ""
    },
    "Result_link": {
      "type": "string",
      "description": ""
    },
    "Title": {
      "type": "string",
      "description": ""
    }
  },
  "title": "Startpage Scraper output",
  "description": "Initial output fields derived from the current published implementation. Field descriptions are maintained by Data Center; production field names and types should be refreshed from recent successful runs.",
  "additionalProperties": false
}
```

## Output Example

Example 1

```json
{
  "Description": "Top 10 Best Heating & Air Conditioning/HVAC Near Jacksonville, Florida - With Real Reviews · VAYO Systems · Aqua Breeze Plumbing and AC · Byrd's Air · NexGen ...",
  "Keyword": "hvac contractor Jacksonville FL",
  "Result_link": "https://www.yelp.com/search?cflt=hvac&find_loc=Jacksonville%2C+FL",
  "Title": "THE BEST 10 Heating & Air Conditioning/HVAC in JACKSONVILLE ..."
}
```

Example 2

```json
{
  "Description": "In Jackson, MS, the contractor to look to for residential and commercial service is AirSouth Cooling and Heating. We offer free consultations and free second ...",
  "Keyword": "hvac contractor Jackson MS",
  "Result_link": "https://www.airsouthnow.com/service-areas/jackson-ms-hvac",
  "Title": "HVAC Contractor in Jackson, MS | AC & Heating Services"
}
```

Example 3

```json
{
  "Description": "Reliable Heating & Air provides expert A/C repair, A/C replacement, and maintenance for HVAC, plumbing, water heaters, generators and more.",
  "Keyword": "heating and cooling Atlanta GA",
  "Result_link": "https://reliableair.com/",
  "Title": "Reliable Heating & Air: Atlanta AC Repair, HVAC Service & Install ..."
}
```

## API

`POST https://openapi.octoparse.com/api/agentTools/executeTask`

This is the OpenAPI Agent Tools `executeTask` endpoint. Authenticate with a Bearer token.

Request body:

`templateName` is the template slug; `parameters` is a JSON object string whose keys match Input Schema; `taskName`, `idempotencyKey`, and `maxCollectedRows` are optional.

Obtain a token:

```http
POST https://openapi.octoparse.com/token
Content-Type: application/json

{
  "username": "YOUR_USERNAME",
  "password": "YOUR_PASSWORD",
  "grant_type": "password"
}
```

Use `data.access_token` as `Authorization: Bearer <token>`. After starting, poll `getTaskStatus` and export with `exportData`.

```json
{
  "templateName": "startpage-scraper",
  "taskName": "Startpage Scraper",
  "parameters": "{\"keyword\":[\"hvac contractor Jacksonville FL\",\"heating and cooling Jacksonville FL\",\"hvac contractor Bunnell FL\",\"heating and cooling Bunnell FL\",\"hvac contractor Port St. Lucie FL\"]}"
}
```

## Python Example

```python
import json
import requests

OPENAPI_BASE = "https://openapi.octoparse.com"
ACCESS_TOKEN = "YOUR_ACCESS_TOKEN"

parameters = json.loads("{\"keyword\":[\"hvac contractor Jacksonville FL\",\"heating and cooling Jacksonville FL\",\"hvac contractor Bunnell FL\",\"heating and cooling Bunnell FL\",\"hvac contractor Port St. Lucie FL\"]}")

response = requests.post(
    f"{OPENAPI_BASE}/api/agentTools/executeTask",
    headers={
        "Authorization": f"Bearer {ACCESS_TOKEN}",
        "Content-Type": "application/json",
    },
    json={
        "templateName": "startpage-scraper",
        "taskName": "Startpage Scraper",
        "parameters": json.dumps(parameters, ensure_ascii=False),
    },
    timeout=60,
)
print(response.status_code)
print(response.json())
```

## HTTP/cURL Example

```bash
curl -X POST "https://openapi.octoparse.com/api/agentTools/executeTask" \
  -H "Authorization: Bearer YOUR_ACCESS_TOKEN" \
  -H "Content-Type: application/json" \
  --data-binary @- <<'JSON'
{
  "templateName": "startpage-scraper",
  "taskName": "Startpage Scraper",
  "parameters": "{\"keyword\":[\"hvac contractor Jacksonville FL\",\"heating and cooling Jacksonville FL\",\"hvac contractor Bunnell FL\",\"heating and cooling Bunnell FL\",\"hvac contractor Port St. Lucie FL\"]}"
}
JSON
```

## MCP Setup

Connect an MCP-compatible AI client to `https://mcp.octoparse.com` using browser OAuth or an Octoparse API key. Find `startpage-scraper`, inspect its inputs, create a cloud task with the exact Input Schema keys, and export JSON results.

## Machine-readable Resources

- [Template contract](https://www.octoparse.com/templates/startpage-scraper.json)
- [Manifest](https://www.octoparse.com/templates/startpage-scraper-manifest.json)
