XCrawl is a web data API for developers who need live page content in LLM apps, RAG pipelines and agents. Scrape a URL into Markdown, JSON, HTML or a screenshot; crawl a site with depth and scope rules; map the URLs a domain exposes; or pull structured search results from Google, Bing, DuckDuckGo and other engines. JavaScript rendering, proxy rotation and retries run on XCrawl's side. Official Python and Node.js SDKs, a CLI, an MCP server and an n8n node are available. New accounts start with 1,000 free credits and no credit card is required.
No reviews yet — be the first to share your experience.