robots-txt

When the user wants to configure, audit, or optimize robots.txt. Also use when the user mentions "robots.txt," "crawler rules," "block crawlers," "AI crawlers," "GPTBot," "allow/disallow," "disallow path," "crawl directives," "user-agent," "block Googlebot," "fix robots.txt," "robots.txt blocking,"

By kostja94 · 1,103 installs

npx skills add kostja94/marketing-skills --skill robots-txt

Source repository · Upstream listing