Articles about "Vercel"

No plugins, no server code — but static sites can still control AI crawlers. Learn where robots.txt goes on Hugo and Jekyll, how Netlify and Vercel edge rules help, and how to protect preview URLs.

Learn how to block AI crawlers on Hugo: add robots.txt via the static folder, separate training bots from search bots, control sections, and enforce blocks at your host.

Block GPTBot, ClaudeBot, and other AI crawlers on Vercel with robots.txt, vercel.json edge rules, and middleware — without hurting your Google rankings.