# robots.txt for http://www.netmiser.com/ # by writing a structured text file you can indicate to robots that # certain parts of your server are off-limits to some or all robots # at last count there were approx. 164 robots indexing the web # instead of a robots.txt file you could also use a META TAG to protect # all or part of your site from indexing ... but, that would have to be # done for every page to be excluded. A robots.txt can disallow a directory # # User-agent: * # * means all 164 robots ... can disallow any or all Disallow: /mcse/ # this indicates only the mcse directory at netmiser.com