Omnikite Logo
Omnikite
Toggle theme

Robots.txt & Sitemap Builder

100% In-Browser Privacy

Generate search engine crawl rules and robots.txt directives.

Crawler Directives & Sitemap

Host Domain
Sitemap URL
Crawl Delay (s)
Allowed Paths (1)
/
AI Bot Scraper Disallow Firewall (5 blocked)
Disallowed Paths (4)
# robots.txt generated by Omnikite Privacy Utilities

Host: https://omnikite.com
User-agent: *
Allow: /
Disallow: /api/
Disallow: /admin/
Disallow: /private/
Disallow: /*?*sort=

# Block Specified AI Crawlers & Scrapers
User-agent: GPTBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: PerplexityBot
Disallow: /

User-agent: Bytespider
Disallow: /


Sitemap: https://omnikite.com/sitemap.xml
AdvertisementOmnikite Zero Data Storage
Adsterra Ad Placement Slot (728x90)Configure keys in config/ads.ts to display live campaigns.
Non-Intrusive Banner
100% Zero-Upload Privacy

All computation executes exclusively inside your device memory using Web APIs and WebAssembly. No data or files ever leave your browser.

Real-Time Native Execution

Zero network roundtrips. Operates offline without sending external API requests, delivering instantaneous sub-millisecond computation.

Developer-First Architecture

Engineered with RFC standards, cryptographic primitives (Web Crypto Subtle API), and production-grade formatting libraries.