If the application is set up at the server root (e.g. bugzilla.mozilla.org) then…

If the application is set up at the server root (e.g. bugzilla.mozilla.org) then this robots.txt disallows robots from scanning the site except for the top level file.

If the application is set up at the server root (e.g. bugzilla.mozilla.org) then…
aae337d3 · endico%mozilla.org · 1552368b · aae337d3
Commit aae337d3 authored Jul 29, 2000 by endico%mozilla.org
Hide whitespace changes
Inline Side-by-side

Showing with 3 additions and 0 deletions

robots.txt robots.txt +3 -0

No files found.
--- a/robots.txt
+++ b/robots.txt
+User-agent: *
+Allow: /index.html
+Disallow: /