Articles & Guides
Useful resources for web developers and system administrators
AI
Website AI-Readiness Checklist: 12 Checks With Commands
Website AI-readiness checklist: 12 checks with real curl commands — crawler access, text in raw HTML, JSON-LD, llms.txt, TTFB, and the myths to skip.
AI
How to Get Cited by ChatGPT and Perplexity
Make ChatGPT and Perplexity cite your site: direct answers, schema, original data, presence on Reddit, and access for AI crawlers. Practical steps.
AI
How AI Crawlers Read Your Website: Agents, JS and Logs
How AI crawlers read your site: the three classes of bot and their user agents, JavaScript execution, nginx log analysis, and verifying a bot is real.
AI
GEO: Generative Engine Optimization — a practical handbook
Generative Engine Optimization in practice: AI crawler access, extractable structure, trust signals, schema.org, external mentions and how to measure it.
SEO
robots.txt and AI Bots: Training, Citation, Verification
How to separate AI agents in robots.txt: who trains a model and who answers in real time. Token table, Content-Signal, log analysis and reverse DNS verification.
SEO
Do AI Crawlers Like GPTBot Request Markdown? How to Serve It
Serve AI agents clean markdown via Accept: text/markdown or /page.md URLs: server logic, Content-Type, curl tests and how to see if crawlers ask for it.
SEO
llms.txt: What It Is, How to Create and Validate It
llms.txt is a markdown file at your site root listing your key pages for AI. How it differs from robots.txt, how to write, serve and validate it. Full examples.
Tools
How to Give Claude and Cursor Web Diagnostic Tools
Step by step: connect Claude and Cursor to an MCP server with SSL, DNS, header and security checks in minutes — no install, and no key for public checks.
Monitoring
MCP Server for Monitoring: Connecting Tools to AI
How to use an MCP server for website monitoring: connect SSL, DNS, uptime and security checks to Claude or Cursor and automate your incident diagnostics.
Tools
What Is an MCP Server and Why It Matters
MCP server explained simply: what it is, how the Model Context Protocol gives AI assistants access to real tools and data, and why developers should care.