# Machinehead Software Robots.txt for www.machinehead-software.co.uk # Note: Site was formerly www.xsystems.co.uk/machinehead (a subdirectory of my hosts domain) # Hopefully this should allow the robots to see all of my pages # except the dodgy stuff and things that are better viewed as part # of a web page. # Hopefully this might help reduce the load on Simon's server User-Agent: * Disallow: /images/ Disallow: /java/ Disallow: /sounds/ Disallow: /video/ Disallow: /keepout/ ##dodgy stuff might lurk here Disallow: /newzips/ Disallow: /sounds/ Disallow: /video/ Disallow: /upgrades/ Disallow: /zips/