Web Data · DomScan product

Web Scraping API

Fetch public web pages as HTML, Markdown, or text with synchronous and asynchronous options.

What you get

Fetch public web pages as HTML, Markdown, or text with synchronous and asynchronous options.

SynchronousAsynchronousRESTMCPSDK

Choose this product when

Who it is for

Use focused APIs when a product or workflow needs current public page evidence in a structured response.

Choose this product when

Choose this when you need HTML, text, or markdown from a public page, with rendering or asynchronous collection only when supported and necessary.

What you get

Fetch public web pages as HTML, Markdown, or text with synchronous and asynchronous options.

Endpoints

Review the supported operations, inputs, outputs, execution modes, and response limits before integrating.

POST /v1/scrape View API reference
POST /v1/scrape/jobs View API reference
GET /v1/scrape/jobs/:job_id View API reference
GET /v1/scrape/jobs/:job_id/results View API reference

Credits and authentication

0-20 Authentication required. Check the operation reference for the exact cost and any per-item pricing.

Example operation

Use documented operations to collect, assess, enrich, verify, compare, protect, or monitor public evidence.

POST /v1/scrape

Body Parameters

Parameter Type required
url string required
mode string
Allowed values standardresilientrenderedrendered_resilient
Default standard
optional
output string
Allowed values htmltextmarkdown
Default html
optional

Response Fields

Field Type
data object
data.url string
data.final_url string
data.status integer | null
data.outcome string
data.content_type string | null
data.content string
data.bytes integer
data.truncated boolean
data.redirect_count integer
data.attempt_count integer
data.duration_ms integer
data.fetched_at string
data.headers object
data.rendered boolean
billing object
billing.credits_charged integer
billing.credits_refunded integer
billing.credits_per_item integer
billing.credits_net integer
billing.policy string

Example Request

curl -X POST "https://domscan.net/v1/scrape" \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $DOMSCAN_API_KEY" \
  -d '{
  "url": "https://example.com/",
  "mode": "standard",
  "output": "markdown"
}'

Example Response

{
  "data": {
    "url": "https://example.com",
    "final_url": "https://example.com",
    "status": 1,
    "outcome": "success",
    "content_type": "domain",
    "content": "example",
    "bytes": 1,
    "truncated": false,
    "redirect_count": 1,
    "attempt_count": 1,
    "duration_ms": 1,
    "fetched_at": "2026-08-27T12:00:00Z",
    "headers": {},
    "rendered": false
  },
  "billing": {
    "credits_charged": 1,
    "credits_refunded": 1,
    "credits_per_item": 1,
    "credits_net": 1,
    "policy": "effort_based"
  }
}

Limits and evidence boundaries

The product evaluates public inputs and publicly observable evidence only.
Coverage is bounded by the documented inputs, budgets, sources, and response limits.
Asynchronous jobs return an identifier for status polling and later result retrieval.
Bulk operations process multiple supported inputs while preserving documented item-level outcomes.
Partial means some requested items or components completed while others did not.
Cached indicates that stored evidence was used; review freshness metadata where provided.

Reviewed 2026-08-22

Frequently asked questions

Where can I find the Web Scraping request and response reference?

Use the API reference for Web Scraping to review parameters, response fields, examples, status codes, and supported operation modes.

How should I interpret unknown or incomplete results from Web Scraping?

Unknown or partial results mean that the requested evidence could not be fully determined. Keep the result state, confidence, freshness, and limitations in downstream decisions.

How is Web Scraping priced?

Pricing depends on the operation and execution mode. Check the endpoint reference for the current credit cost, authentication requirement, and per-item rules.

Used by people at amazing companies

InstantOutseerMongoDBRespondentSage Expense ManagementInstantlyD.R. HortonWhatConvertsAdobeMotionElementsLLM Pulse