# robots.txt file from http://www.ketnet.be # # Allows only index.html files to be spidered. User-agent: * Disallow: /ketnet/html/ Disallow: /ketnet/audio/ Disallow: /ketnet/flash/ Disallow: /ketnet/images/ Disallow: /ketnet/includes/ Disallow: /ketnet/java/ Disallow: /ketnet/stylesheets/ Disallow: /ketnet/video/ Disallow: /ketnet/xml/