Comment 5 for bug 1378539

Revision history for this message
Doug Smythies (dsmythies) wrote :

Gunnar,

I thought of what you are wanting to do with the robots.txt file, however there is already one there.
I do not know if one that we try to supply would get overwritten or if we can merge them somehow or whatever.

Also, my thinking was that we would disallow everything except the lts and stable directories and thus the bots would always be pulling form the correct place. My thinking seems to be different that what you are proposing.