web-fetch

Fetches web content as clean markdown by preferring markdown-native responses and falling back to selector-based HTML extraction. Use for documentation, articles, and reference pages at http/https URLs.

By alleneubank · 975 installs

npx skills add alleneubank/claude-code --skill web-fetch

Source repository · Upstream listing

Web Content Fetching Fetch web content in this order: 1. Prefer markdown native endpoints ( content type: text/markdown ) 2. Use selector based HTML extraction for known sites 3. Use the bundled Bun fallback script when selectors fail Prerequisites Verify required tools before extracting: Install Bun dependencies for the bundled script: Default Workflow Use this as the default flow for any URL: Known Site Selectors Site Include Selector Exclude Selector platform.claude.com content container docs.anthropic.com content container developer.mozilla.org article github.com (docs) article nav,.sidebar Generic article,main,[role=main] nav,header,footer,script,style Example: Finding the Right Selector When a site isn't in the patterns list: Universal Fallback Script When selectors produce poor output, run the bundled parser: If already in the skill directory: Options Reference Troubleshooting Empty output with selectors : The page might be markdown native. Check headers first: Wrong content selected : The site may have multiple article/main regions: html2markdown not found : Install it, then retry selector based extraction. bun or script deps missing : Run cd ~/.claude/skills/web fetch && bun install . Missing code blocks : Check if the site uses non standard code formatting. Client rendered content : If HTML only has "Loading..." placeholders, the content is JS rendered. Neither curl nor the Bun script can extract it; use browser based tools.