SEO & WebLive Tool100% Browser-Based

Robots.txt Generator

Create robots.txt files for your website.

Configuration

User Agent

Use * for all bots, or specify (e.g., Googlebot, Bingbot)

Rules

Crawl Delay (optional)

Seconds between requests (not all bots support this)

Sitemap URL (optional)

Generated robots.txt

User-agent: *
allow: /
disallow: /admin/

Related tools

Keep working in the same category with nearby utilities and calculators.

Meta Tags Generator

Generate SEO-friendly meta tags including Open Graph output.

Sitemap Generator

Generate XML sitemaps from a list of URLs.

SSL Checker

Check SSL certificate status for any domain with graceful fallbacks.

DNS Lookup

Look up DNS records for any domain with resilient browser-safe handling.

IP Address Lookup

Find your IP address and location information with client-side fallbacks.