web-fetch
Fetches web content as clean markdown by preferring markdown-native responses and falling back to selector-based HTML extraction. Use for documentation, articles, and reference pages at http/https URLs.
By alleneubank · 975 installs
npx skills add alleneubank/claude-code --skill web-fetch
Source repository · Upstream listing
Web Content Fetching
Fetch web content in this order:
1. Prefer markdown native endpoints ( content type: text/markdown )
2. Use selector based HTML extraction for known sites
3. Use the bundled Bun fallback script when selectors fail
Prerequisites
Verify required tools before extracting:
Install Bun dependencies for the bundled script:
Default Workflow
Use this as the default flow for any URL:
Known Site Selectors
Site Include Selector Exclude Selector
platform.claude.com content container
docs.anthropic.com content container
developer.mozilla.org article
github.com (docs) article nav,.sidebar
Generic article,main,[role=main] nav,header,footer,script,style
Example:
Finding the Right Selector
When a site isn't in the patterns list:
Universal Fallback Script
When selectors produce poor output, run the bundled parser:
If already in the skill directory:
Options Reference
Troubleshooting
Empty output with selectors : The page might be markdown native. Check headers first:
Wrong content selected : The site may have multiple article/main regions:
html2markdown not found : Install it, then retry selector based extraction.
bun or script deps missing : Run cd ~/.claude/skills/web fetch && bun install .
Missing code blocks : Check if the site uses non standard code formatting.
Client rendered content : If HTML only has "Loading..." placeholders, the content is JS rendered. Neither curl nor the Bun script can extract it; use browser based tools.