🕷️网页抓取 MCP 推荐

Web scraping, search, monitoring, and HTML-to-markdown for AI agents

Section-level doc search for .md, .rst, .adoc, .ipynb, .html, .yaml, .json, and OpenAPI specs.

MCP server that turns HTML MUP panels into interactive UI tools for LLMs.

Analyze Figma designs for dev & AI readiness. 39 rules, scoring, HTML reports.

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.

Browser-grade web access for AI agents. Fetches any webpage, returns clean markdown.

Token compression for web content — 70-80% reduction from HTML to clean markdown

Universal web content extraction — any URL to LLM-ready markdown. HTML, YouTube, PDF, DOCX.

MCP server for ZebPay crypto exchange — fetch prices, balances, and manage orders

35+ web scraping tools. Firecrawl, Bright Data, Jina, Olostep, ScrapeGraph, Notte, Riveter.

40+ competitive intel tools. Brand.dev, Coresignal, Keywords Everywhere, Exa, Firecrawl.

B2B lead generation MCP server - 20+ scrapers, email finder, skip trace, and more.

ZenRows MCP server — Universal Scraper API for AI coding assistants

Markdown to styled HTML, PDF, DOCX, and slides with themes, diagrams, and math.

Fetch pages as markdown, search web and news, extract structured data. For AI agents.

Web scraping MCP — extract clean markdown, links, and metadata from any URL.

MCP server for codewiki.google: search repos, fetch wiki docs, ask questions

Monitor web pages for changes with AI-powered change detection, diffs, and alerts.

AEO audit: score any website 0-100 for AI visibility. Checks schema, meta, content, AI crawlers.

Give your AI the ability to read the web. Fetches URLs as clean markdown with multi-tier fallback.

Convert PDF, DOCX, HTML, Markdown, and Text for AI assistant context injection.

Fetch a URL and get clean Markdown with metadata. No API key required; rate-limited per IP.

Crawl websites, export SEO data, and manage crawls via Screaming Frog SEO Spider.

Instant web publishing for AI agents. POST HTML, get a live URL. No account needed.

Structured web intelligence for AI agents. 5x fewer tokens than Playwright/Firecrawl, 84.7% accuracy

Convert Markdown, HTML, and web pages to high-quality PDF with Prince.

MCP server for web scraping: URLs, links, metadata, CSS extraction.

MCP server for markdown: tables, TOC, HTML conversion, formatting.

MCP server for generating production-ready HTML landing pages.

MCP server for Base64, URL, and HTML encoding/decoding

Markdown processing, TOC generation, HTML conversion

Generate HTML meta tags and Open Graph metadata

Rust MCP stealth scraper: anti-bot search/scrape with CDP fallback + HITL non-robot.

Deploy and manage instant HTML sites with paste, upload, and ZIP deploy

Convert HTML or URLs to PDF documents powered by Playwright

MCP server for OpenGraph.io API - fetch OG data, screenshots, scrape, and generate images

PubMed literature search and US/UK drug labelling for AI assistants.

Stealth scraping & search. Bypasses Cloudflare, DataDome & LinkedIn via Cyborg HITL approach.

Fetch any web page as clean, AI-ready markdown with smart HTTP-to-browser escalation.

AI-powered web scraping and data extraction capabilities through ScrapeGraph API

Search, chat, upload, and scrape a serverless RAGStack knowledge base on AWS.

Crawl and analyse websites for SEO errors using Crawlee with SQLite storage

Lightweight DMARC parser: auto-fetch email reports, visualize compliance in a single all-in-one app

The audio intelligence layer. Search podcast transcripts, speakers, and entities across 250K+ shows.

Twitter/X analysis without token waste. Fetch tweets, download media. No API key.

An MCP server for generating images from HTML & CSS or screenshots of URLs using htmlcsstoimage.com.

AI agent gateway with web fetching, data extraction, crypto pricing, and x402 payments

Hosted Crawleo MCP (remote streamable HTTP endpoint).