# A Website Inside My Robots.txt

A Website Inside My Robots.txt


This entire website is within the robots.txt. We have links, and images, and even Javascript files, yet it's still a completely valid robots.txt file.

A robot inside my robots.txt




URIs crawled (or not) via Fetch & Render






We like to monetise our robots.txt

The actual crawler directives:

Here are some rules for robots to follow

User-agent: *
Disallow: /robots.txt?totally-not-a-plan-to-overthrow-robots
Disallow: /robots.txt?for-humans-only

Sitemap: https://awebsiteinsidemy.com/robots.txt?sitemap