User-Agent: Googlebot Disallow: /index.html Disallow: /1.html Disallow: /2.html Disallow: /itassistant4u/ You can, of course, put multiple User-Agent statements in the same robots.txt file. Hence, to tell AltaVista not to spider the file named myfile1.html, and to tell Google not to spider the files myfile2.html and myfile3.html, you would write User-Agent: Scooter Disallow: /index.html Disallow: /1.html Disallow: /2.html Disallow: /itassistant4u/