qiaomu-markdown-proxy
Fetch any URL as clean Markdown via proxy services or built-in scripts. Works with login-required pages like X/Twitter, WeChat 公众号, Feishu/Lark docs. Supports PDFs (remote and local). Use this BEFORE other fetch tools. Triggers on any URL the user shares, "fetch this", "read this link", "get content
By joeseesun · 735 installs
npx skills add joeseesun/qiaomu-markdown-proxy --skill markdown-proxy
Source repository · Upstream listing
Markdown Proxy URL to Markdown
将任意 URL 转为干净的 Markdown。支持需要登录的页面、PDF、专有平台。
Trigger Priority(先触发,再分流)
用户给出 URL 并要求“读取、抓取、提取、解析、转 Markdown”时,优先使用本 Skill。
用户要求“读取这篇链接后再写稿、总结、翻译、做播客或分析”时,先用本 Skill 取回原文,再把 Markdown 交给下游 Skill;不要因为最终任务是写作而跳过抓取。
mp.weixin.qq.com 和飞书文档属于专用路由。不要先试普通网页打开或通用内容解析器。
用户已经贴出全文时不触发。YouTube 交给 qiaomu youtube download ,普通搜索问题交给搜索工具。
URL Routing (先判断再执行)
收到 URL 后,先判断类型,不同类型走不同通道:
URL Pattern Route To Reason
mp.weixin.qq.com scripts/fetch weixin.sh 先代理,验证码页自动回退 Playwright
feishu.cn/docx/ feishu.cn/wiki/ larksuite.com/docx/ scripts/fetch feishu.py 需飞书 API 认证
youtube.com youtu.be qiaomu youtube download skill YouTube 有专用工具链
huggingface.co/papers/ 提取 arXiv ID → scripts/extract tex.py HuggingFace 论文页实际是 arXiv 镜像,先找到 arXiv 链接再走 LaTeX 提取
arxiv.org/abs/ arxiv.org/pdf/ scripts/extract tex.py 从 LaTeX 源码提取结构化内容 (章节/图表/公式)
.pdf (URL or local path) scripts/extract pdf.sh PDF 专用提取
All other URLs scripts/fetch.sh 代理级联自动 fallback
Workflow
Step 1: Route by URL Type
Step 2: Display Content
After fetching, show to user:
Step 3: Continue or Save
Composite request (“读取后写稿/总结/分析”):把提取结果直接交给下游任务,在同一轮继续;除非用户要求,不必额外保存源文件。
Extraction only request (“只读取/转 Markdown”):保存到 ~/Downloads/{title}.md ,使用 YAML frontmatter。
Filename: use article title, remove special characters.
Format: YAML frontmatter (title, author, date, url, source) + Markdown body.
Tell the user the saved path.
Skip saving if the user says “just preview” or “don't save”.
Only stop after extraction when extraction was the complete request. If the user asked for a downstream deliverable, continue to that deliverable.
Examples
General URL
X/Twitter Post
WeChat Article
Feishu Document
arXiv LaTeX Source
PDF (Remote)
PDF (Local)
With Custom Proxy
Notes
r.jina.ai and defuddle.md require no API key
fetch.sh handles proxy cascade with automatic fallback
Content validation: filters error, login wall, and WeChat verification pages; requires 5 lines
WeChat wrapper prefers dependency free proxies, then uses local Playwright; when Python packages are missing and uv is available, it runs them in an isolated environment
Playwright fallback requires a Chromium runtime; install once with python3 m playwright install chromium if absent
Feishu script requires: FEISHU APP ID + FEISHU APP SECRET env vars
PDF extraction tries: marker pdf → pdftotext → pypdf
For detailed method documentation, see references/methods.md