Feigning normality since 1973
My precious files!
Filed in: Internet.
I'm trying to work out something: Exactly why is the University of Mannheim so interested in my robots.txt file?
The only reason I block robots from indexing the "shared" directory is because stuff in there is hotlinkable - I put pictures in there so people reading my weblog via the rss feed can see the pictures without having to come visit the site itself. But I don't want random people finding the pictures on Google Images and then hotlinking to them from message boards/myspace/etc.
So far as I can tell, it's some sort of security project... perhaps they're looking at robots.txt because people will be blocking directories containing supersecret files. If you have files you don't want people to find, don't put them on the Internets!
Posted November 26, 2005 7:49 PM
Post a comment