Web Content Fetcher
VerifiedWeb Content Fetcher — documentation and writing tool. Supports r.jina.ai, markdown.new, Cloudflare, defuddle.md.
$ Add to .claude/skills/ About This Skill
Content available in Chinese
# 网页内容获取工具
当常规 web_fetch/web_search 无法获取内容时,使用替代服务获取网页 Markdown 格式内容。
支持的服务
| 优先级 | 服务 | 用法 | 适用场景 | |--------|------|------|----------| | 1 | r.jina.ai | `https://r.jina.ai/{url}` | 最稳定,通用性强 | | 2 | markdown.new | `https://markdown.new/{url}` | Cloudflare 保护网站 | | 3 | defuddle.md | `https://defuddle.md/{url}` | 备用方案 |
使用方法
直接调用
当需要获取网页内容时,按顺序尝试:
- 首先用 `web_fetch` 尝试获取
- 如果失败或被过滤,调用本工具
```bash # 使用 jina.ai (首选) curl -s "https://r.jina.ai/https://example.com"
# 使用 markdown.new (Cloudflare) curl -s "https://markdown.new/https://example.com"
# 使用 defuddle.md (备用) curl -s "https://defuddle.md/https://example.com" ```
API 格式
```bash # 简单获取 fetch_webpage <url>
# 指定方法 fetch_webpage <url> --method jina|markdown|defuddle ```
示例
``` 用户: 帮我获取 https://news.example.com/article/123 的内容 助手: (使用 r.jina.ai 获取) ```
工具脚本
本目录包含 `fetch.sh` 脚本,可直接调用:
```bash ./fetch.sh https://example.com ./fetch.sh https://example.com jina ```
---
*让网页内容获取不再受限 🌐*
Use Cases
- Fetch web content through r.jina.ai for clean markdown conversion
- Use markdown.new as an alternative web content extraction endpoint
- Bypass Cloudflare protection with defuddle.md for protected sites
- Extract readable content from web pages for documentation and research
- Build content pipelines that convert web pages to structured markdown
Pros & Cons
Pros
- +Multiple extraction backends — r.jina.ai, markdown.new, Cloudflare, defuddle.md
- +Fallback options when one service is blocked or rate-limited
- +Markdown output integrates directly into documentation workflows
Cons
- -Depends on third-party services that may change pricing or availability
- -No local extraction capability — requires internet access
FAQ
What does Web Content Fetcher do?
What platforms support Web Content Fetcher?
What are the use cases for Web Content Fetcher?
100+ free AI tools
Writing, PDF, image, and developer tools — all in your browser.
Next Step
Use the skill detail page to evaluate fit and install steps. For a direct browser workflow, move into a focused tool route instead of staying in broader support surfaces.