Context.dev
Web scraping API for AI agents: scrape any URL into LLM-ready Markdown, crawl entire sites, and extract structured data with one REST API.
What is Context.dev?
Context.dev is a web scraping API designed for AI agents and software teams. It provides a single REST API to scrape any URL into clean Markdown, crawl entire websites, extract structured data using JSON Schema, retrieve brand data, styleguides, product listings, screenshots, and more. The service is backed by Y Combinator and used by companies like Super.com, Mintlify, and Similarweb. It offers a free tier with 500 credits and no credit card required.
What can Context.dev do?
Scrape web content
Scrape any URL or crawl an entire site for clean markdown, rendered HTML, or extracted images.
Extract structured data
Crawl any site and extract structured data into a JSON Schema you define.
Extract site map
Crawl and discover all page URLs from any domain via sitemap.
Retrieve brand data
Resolve a full brand profile by company identifier, or extract details from one specific page URL.
Extract styleguide
Get the complete visual identity: colors, elements, and fonts from any website.
Get products
Extract product listings or individual product details with AI.
Capture screenshots
Generate high-quality viewport or full-page screenshots of any website.
Identify transaction
Match transaction strings to brands with optional location and MCC hints.
Who is Context.dev for?
- AI agents
- Give an agent real-time access to any page by scraping to markdown, rendering JS, and extracting images.
- RAG systems
- Ground RAG in fresh content by crawling a sitemap and converting pages to markdown for embeddings.
- Research tools
- Run deep research on demand by resolving a domain to a typed profile and expanding with custom AI queries.
Context.dev has a free plan, with paid upgrades for more usage or features.
Frequently Asked Questions
+4Looking for something else?
Compare Context.dev with similar tools on pricing, features and traffic.