For developers, data teams, researchers, and agent builders
Use this workflow for bounded page collection, content extraction, research inputs, and public-page context.
Solution for data collection
Collect public web pages in a form your application can use
Choose the lowest sufficient collection mode, retain destination evidence, and enrich the result only when the workflow needs it.
Usable page content with collection context
Receive HTML, text, or markdown plus final-destination and processing evidence for each supported request.
A URL alone is not a reliable content record
The page may redirect, require JavaScript, exceed bounded response size, or expose only part of the context your application needs.
Collection is bounded and access is not guaranteed
DomScan does not bypass authentication, paywalls, access controls, or target restrictions, and does not promise that every public URL can be collected.
Workflow
Receive HTML, text, or markdown plus final-destination and processing evidence for each supported request.
Inspect and normalize the target URL
Use URL Intelligence or Redirects when destination or URL risk signals should be checked before collection.
Collect with the lowest sufficient mode
Start with standard Scrape, choose resilient retry behavior only when useful, and use rendering only for JavaScript-dependent content.
Add structured context where it changes the decision
Request Website Categorization or Technology Detection after collection when the downstream task needs those signals.
Collect a public article as markdown
Submit the article URL in standard mode, retain the final URL, and add category evidence only if the application uses it.
Example Request
curl -X POST "https://domscan.net/v1/scrape" -H "X-API-Key: $DOMSCAN_API_KEY" -H "Content-Type: application/json" -d '{"url":"https://example.com","output":"markdown"}'Example Response
{
"data": {
"url": "https://example.com",
"outcome": "success",
"content": "# Example Domain",
"truncated": false
},
"billing": { "credits_charged": 1, "credits_refunded": 0 }
}Products in this workflow
Receive HTML, text, or markdown plus final-destination and processing evidence for each supported request.
Web Scraping
Fetch public web pages as HTML, Markdown, or text with synchronous and asynchronous options.
Choose this when: Fetch public web pages as HTML, Markdown, or text with synchronous and asynchronous options.
- Inputs
- URL
- Outcomes
- Collect
- Credits
- 0-20
SynchronousAsynchronousRESTMCPSDK
Unified URL Intelligence
Extract normalized page metadata, preview fields, structured data, and public identity signals from a URL.
Choose this when: Extract normalized page metadata, preview fields, structured data, and public identity signals from a URL.
- Inputs
- URL
- Outcomes
- Collect, Enrich
- Credits
- 2
SynchronousBulkRESTMCPSDK
Website Categorization
Categorize a website by industry, content type, and topics.
Choose this when: Categorize a website by industry, content type, and topics.
- Inputs
- URL, Domain
- Outcomes
- Enrich, Assess
- Credits
- 0-3
SynchronousBulkRESTMCPSDKInteractive tool
Asynchronous API batches
Queue many supported API requests and collect their results without keeping a client connection open.
Choose this when: Queue many supported API requests and collect their results without keeping a client connection open.
- Inputs
- Domain, URL, Email address
- Outcomes
- Automate
- Credits
- 0
AsynchronousRESTMCPSDK
Choose this workflow when
Choose this when
You need bounded public-page content with explicit destination, mode, and processing context.
Not for
Do not use it to bypass access controls, crawl an unlimited site, or guarantee collection of every target.
Related product suites
Usable page content with collection context
Choose the lowest sufficient collection mode, retain destination evidence, and enrich the result only when the workflow needs it.