Articles & Guides
Useful resources for web developers and system administrators
Found 22 · SEO · Reset
SEO
robots.txt and AI Bots: Training, Citation, Verification
How to separate AI agents in robots.txt: who trains a model and who answers in real time. Token table, Content-Signal, log analysis and reverse DNS verification.
SEO
Do AI Crawlers Like GPTBot Request Markdown? How to Serve It
Serve AI agents clean markdown via Accept: text/markdown or /page.md URLs: server logic, Content-Type, curl tests and how to see if crawlers ask for it.
SEO
llms.txt: What It Is, How to Create and Validate It
llms.txt is a markdown file at your site root listing your key pages for AI. How it differs from robots.txt, how to write, serve and validate it. Full examples.
SEO
Subdomain vs Subdirectory for SEO: Which Structure Wins?
Compare subdomains and subdirectories for SEO. Learn the pros, cons, and when to use each URL structure to maximize search engine visibility and domain authority.
SEO
Sitemap XML: Structure, Limits, Generation and Validation
Sitemap.xml explained: urlset and url structure, the 50,000 URL and 50 MB limits, sitemap index, hreflang, generation, the robots.txt line and validation.
SEO
Website Accessibility: Why Overlay Widgets Do Not Work
Why an accessibility overlay does not make a site accessible, which practical minimum removes most barriers — semantics, contrast, keyboard — and how to test all of it.
SEO
robots.txt Guide: Syntax, Rules, Testing and Ready-Made Files
A complete robots.txt guide: RFC 9309 syntax, user-agent groups, Allow precedence, blocking a site from crawling, plus ready files for WordPress, Tilda and Bitrix.
SEO
Structured Data for SEO: Schema.org Guide
Learn how to implement Schema.org structured data to enhance search engine results with rich snippets, knowledge panels, and better visibility.
SEO
Website Migration Checklist: Avoid SEO and Downtime Pitfalls
A complete checklist for website migration — preserve SEO rankings, avoid downtime, handle redirects, DNS changes, and post-migration monitoring.
SEO
Website SEO Audit: 20-Point Checklist
Practical SEO audit checklist: 20 points to check technical SEO, content, performance, and security.