Mandala
Tools

Context.dev

Scrape, crawl, search, extract, and enrich web and brand data

Usage Instructions

Integrate Context.dev into the workflow. Scrape pages to markdown or HTML, capture screenshots, list images, crawl entire sites, map sitemaps, search the web, extract structured data and products, pull design systems, classify industries, and retrieve brand assets by domain, name, email, ticker, or transaction — all from one API.

Tools

context_dev_scrape_markdown

Scrape any URL and return clean, LLM-ready markdown content.

Input

ParameterTypeRequiredDescription
urlstringYesThe full URL to scrape (must include http:// or https://)
useMainContentOnlybooleanNoReturn only main content, excluding headers, footers, and navigation
includeLinksbooleanNoPreserve hyperlinks in the markdown output (default: true)
includeImagesbooleanNoInclude image references in the markdown output (default: false)
includeFramesbooleanNoRender iframe contents inline (default: false)
maxAgeMsnumberNoCache duration in milliseconds (0-2592000000, default: 86400000)
waitForMsnumberNoBrowser wait time after page load in milliseconds (0-30000)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
markdownstringPage content as clean markdown
urlstringThe scraped URL
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_scrape_html

Scrape any URL and return the raw HTML content of the page.

Input

ParameterTypeRequiredDescription
urlstringYesThe full URL to scrape (must include http:// or https://)
useMainContentOnlybooleanNoReturn only main content, excluding headers, footers, and navigation
includeFramesbooleanNoRender iframe contents inline into the returned HTML (default: false)
maxAgeMsnumberNoCache duration in milliseconds (0-2592000000, default: 86400000)
waitForMsnumberNoBrowser wait time after page load in milliseconds (0-30000)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
htmlstringRaw HTML content of the page
urlstringThe scraped URL
typestringDetected content type (html, xml, json, text, csv, markdown, svg, pdf, doc, docx)
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_scrape_images

Discover every image asset on a page, with optional dimension and type enrichment.

Input

ParameterTypeRequiredDescription
urlstringYesThe full URL to scrape images from (must include http:// or https://)
maxAgeMsnumberNoCache duration in milliseconds (0-2592000000, default: 86400000)
waitForMsnumberNoBrowser wait time after page load in milliseconds (0-30000)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
enrichResolutionbooleanNoMeasure image dimensions (enables 5-credit enrichment)
enrichHostedUrlbooleanNoHost images on a CDN and return their URL and MIME type (enables enrichment)
enrichClassificationbooleanNoClassify each image by visual asset type (enables enrichment)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
successbooleanWhether the scrape succeeded
imagesarrayDiscovered image assets with source, element, type, and optional enrichment
urlstringThe scraped URL
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_screenshot

Capture a screenshot of any web page and store it as a downloadable image file.

Input

ParameterTypeRequiredDescription
urlstringYesThe full URL to capture (must include http:// or https://)
fullScreenshotbooleanNoCapture the full scrollable page instead of just the viewport (default: false)
handleCookiePopupbooleanNoAttempt to dismiss cookie banners before capturing (default: false)
viewportWidthnumberNoViewport width in pixels (240-7680, default: 1920)
viewportHeightnumberNoViewport height in pixels (240-4320, default: 1080)
maxAgeMsnumberNoCache duration in milliseconds (0-2592000000, default: 86400000)
waitForMsnumberNoPost-load delay before capturing in milliseconds (0-30000, default: 3000)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
filefileStored screenshot image file
screenshotUrlstringPublic URL of the captured screenshot
screenshotTypestringScreenshot type (viewport or fullPage)
domainstringDomain that was captured
widthnumberScreenshot width in pixels
heightnumberScreenshot height in pixels
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_crawl

Crawl an entire website and return each discovered page as clean markdown.

Input

ParameterTypeRequiredDescription
urlstringYesThe starting URL to crawl (must include http:// or https://)
maxPagesnumberNoMaximum number of pages to crawl (1-500, default: 100)
maxDepthnumberNoMaximum link depth from the starting URL (0 = start page only)
urlRegexstringNoRegex pattern to filter which URLs are crawled
includeLinksbooleanNoPreserve hyperlinks in the markdown output (default: true)
includeImagesbooleanNoInclude image references in the markdown output (default: false)
useMainContentOnlybooleanNoStrip headers, footers, and sidebars from each page (default: false)
followSubdomainsbooleanNoFollow links to subdomains of the starting domain (default: false)
maxAgeMsnumberNoCache duration in milliseconds (0-2592000000, default: 86400000)
waitForMsnumberNoBrowser wait time after page load in milliseconds (0-30000)
stopAfterMsnumberNoSoft crawl time budget in milliseconds (10000-110000, default: 80000)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
resultsarrayCrawled pages with markdown content and per-page metadata
metadataobjectCrawl summary (numUrls, maxCrawlDepth, numSucceeded, numFailed, numSkipped)
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_map

Build a sitemap of a domain and return every discovered page URL.

Input

ParameterTypeRequiredDescription
domainstringYesThe domain to build a sitemap for (e.g., "example.com")
maxLinksnumberNoMaximum number of URLs to return (1-100000, default: 10000)
urlRegexstringNoRE2-compatible regex to filter URLs (max 256 chars)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
domainstringThe domain that was mapped
urlsarrayAll page URLs discovered from the sitemap
metaobjectSitemap discovery stats (sitemapsDiscovered, sitemapsFetched, sitemapsSkipped, errors)
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

Search the web with natural language and optionally scrape results to markdown.

Input

ParameterTypeRequiredDescription
querystringYesThe natural language search query (1-500 characters)
includeDomainsarrayNoOnly return results from these domains
excludeDomainsarrayNoExclude results from these domains
freshnessstringNoRecency filter (last_24_hours, last_week, last_month, last_year)
numResultsnumberNoNumber of results to return (10-100, default 10)
countrystringNoRestrict results to a country (ISO 3166-1 alpha-2 code, e.g. US)
queryFanoutbooleanNoExpand the query into parallel variants for broader coverage
markdownEnabledbooleanNoScrape each result page to markdown (default: false)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
resultsarraySearch results with url, title, description, relevance, and optional markdown
querystringThe query that was searched
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_extract

Crawl a website and extract structured data matching a provided JSON schema.

Input

ParameterTypeRequiredDescription
urlstringYesThe starting website URL (must include http:// or https://)
schemajsonYesJSON Schema describing the structure of the data to extract
instructionsstringNoOptional extraction guidance for link prioritization (max 2000 chars)
factCheckbooleanNoRequire extracted values to be grounded in page facts (default: false)
followSubdomainsbooleanNoFollow links on subdomains of the starting domain (default: false)
maxPagesnumberNoMaximum number of pages to analyze (1-50, default: 5)
maxDepthnumberNoMaximum link depth from the starting URL
maxAgeMsnumberNoCache duration in milliseconds (0-2592000000, default: 604800000)
stopAfterMsnumberNoSoft crawl time budget in milliseconds (10000-110000, default: 80000)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
statusstringExtraction status
urlstringThe starting URL that was crawled
urlsAnalyzedarrayURLs that were analyzed during extraction
datajsonStructured data matching the requested schema
metadataobjectCrawl summary (numUrls, maxCrawlDepth, numSucceeded, numFailed, numSkipped)
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_extract_product

Detect and extract structured product details from a single product page URL.

Input

ParameterTypeRequiredDescription
urlstringYesThe product page URL (must include http:// or https://)
maxAgeMsnumberNoCache duration in milliseconds (0-2592000000, default: 604800000)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
isProductPagebooleanWhether the URL is a product page
platformstringDetected platform (amazon, tiktok_shop, etsy, generic)
productobjectExtracted product details
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_extract_products

Extract the product catalog from a brand's website by domain (beta).

Input

ParameterTypeRequiredDescription
domainstringYesThe domain to extract products from (e.g., "example.com")
maxProductsnumberNoMaximum number of products to extract (1-12)
maxAgeMsnumberNoCache duration in milliseconds (0-2592000000, default: 604800000)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
productsarrayExtracted products with pricing, features, and metadata
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_scrape_fonts

Extract the font families, usage stats, and font files used by a domain.

Input

ParameterTypeRequiredDescription
domainstringYesThe domain to extract fonts from (e.g., "example.com")
maxAgeMsnumberNoCache max age in milliseconds (86400000-31536000000, default: 7776000000)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
statusstringExtraction status
domainstringThe domain that was analyzed
fontsarrayFonts with usage statistics and fallbacks
fontLinksjsonFont family download links keyed by font name (type, files, category)
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_scrape_styleguide

Extract a domain's design system: colors, typography, spacing, shadows, and UI components.

Input

ParameterTypeRequiredDescription
domainstringYesThe domain to extract the styleguide from (e.g., "example.com")
maxAgeMsnumberNoCache max age in milliseconds (86400000-31536000000, default: 7776000000)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
statusstringExtraction status
domainstringThe domain that was analyzed
styleguidejsonDesign system: mode, colors, typography, elementSpacing, shadows, fontLinks, components
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_classify_naics

Classify a brand into NAICS industry codes from its domain or company name.

Input

ParameterTypeRequiredDescription
inputstringYesBrand domain or company name to classify (e.g., "stripe.com" or "Stripe")
minResultsnumberNoMinimum number of codes to return (1-10, default: 1)
maxResultsnumberNoMaximum number of codes to return (1-10, default: 5)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
statusstringClassification status
domainstringResolved domain
typestringInput type that was resolved
codesarrayMatched NAICS codes with name and confidence
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_classify_sic

Classify a brand into SIC industry codes from its domain or company name.

Input

ParameterTypeRequiredDescription
inputstringYesBrand domain or company name to classify (e.g., "stripe.com" or "Stripe")
typestringNoSIC taxonomy version: "original_sic" (default) or "latest_sec"
minResultsnumberNoMinimum number of codes to return (1-10, default: 1)
maxResultsnumberNoMaximum number of codes to return (1-10, default: 5)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
statusstringClassification status
domainstringResolved domain
typestringInput type that was resolved
classificationstringSIC taxonomy version used (original_sic or latest_sec)
codesarrayMatched SIC codes with name, confidence, and group metadata
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_get_brand

Retrieve brand data for a domain: logos, colors, backdrops, socials, address, and industry.

Input

ParameterTypeRequiredDescription
domainstringYesThe domain to retrieve brand data for (e.g., "airbnb.com")
forceLanguagestringNoOverride the detected language with a supported language code
maxSpeedbooleanNoSkip time-consuming operations for a faster response (default: false)
maxAgeMsnumberNoCache max age in milliseconds (86400000-31536000000, default: 7776000000)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
statusstringRetrieval status
brandobjectBrand data object
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_get_brand_by_name

Retrieve brand data by company name: logos, colors, socials, address, and industry.

Input

ParameterTypeRequiredDescription
namestringYesCompany name to retrieve brand data for (3-30 chars, e.g., "Apple Inc")
countryGlstringNoISO 2-letter country code to prioritize (e.g., "us")
forceLanguagestringNoOverride the detected language with a supported language code
maxSpeedbooleanNoSkip time-consuming operations for a faster response (default: false)
maxAgeMsnumberNoCache max age in milliseconds (86400000-31536000000, default: 7776000000)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
statusstringRetrieval status
brandobjectBrand data object
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_get_brand_by_email

Retrieve brand data from a work email address. Free/disposable emails are rejected (422).

Input

ParameterTypeRequiredDescription
emailstringYesWork email address; the domain is extracted (free providers are rejected)
forceLanguagestringNoOverride the detected language with a supported language code
maxSpeedbooleanNoSkip time-consuming operations for a faster response (default: false)
maxAgeMsnumberNoCache max age in milliseconds (86400000-31536000000, default: 7776000000)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
statusstringRetrieval status
brandobjectBrand data object
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_get_brand_by_ticker

Retrieve brand data for a public company by its stock ticker symbol.

Input

ParameterTypeRequiredDescription
tickerstringYesStock ticker symbol (e.g., "AAPL", "GOOGL", "BRK.A")
tickerExchangestringNoExchange code for the ticker (e.g., "NASDAQ", "NYSE", "LSE"). Default: NASDAQ
forceLanguagestringNoOverride the detected language with a supported language code
maxSpeedbooleanNoSkip time-consuming operations for a faster response (default: false)
maxAgeMsnumberNoCache max age in milliseconds (86400000-31536000000, default: 7776000000)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
statusstringRetrieval status
brandobjectBrand data object
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

context_dev_identify_transaction

Identify the brand behind a raw bank/card transaction descriptor and return its brand data.

Input

ParameterTypeRequiredDescription
transactionInfostringYesThe raw transaction descriptor or identifier to resolve to a brand
countryGlstringNoISO 2-letter country code from the transaction (e.g., "us", "gb")
citystringNoCity name to prioritize in the search
mccstringNoMerchant Category Code for the business category
phonenumberNoPhone number from the transaction for verification
highConfidenceOnlybooleanNoEnforce additional verification steps for higher confidence (default: false)
forceLanguagestringNoOverride the detected language with a supported language code
maxSpeedbooleanNoSkip time-consuming operations for a faster response (default: false)
timeoutMSnumberNoRequest timeout in milliseconds (1000-300000)
apiKeystringYesContext.dev API key

Output

ParameterTypeDescription
statusstringIdentification status
brandobjectBrand data for the identified merchant
creditsConsumednumberCredits consumed by this request
creditsRemainingnumberCredits remaining on the API key

Notes

  • Category: tools
  • Type: context_dev
Context.dev