############################### # # User-agent: * # # list folders robots are not allowed to index # Disallow: /_db_import/ Disallow: /_includes/ Disallow: /_email/ Disallow: /_pemail/ Disallow: /_private/ Disallow: /_vti_pvt/ Disallow: /art/ Disallow: /aspnet_client/ Disallow: /ATS_test/ Disallow: /career/resumes/ Disallow: /cgi-shl/ Disallow: /cgi-scr/ Disallow: /cgi-win/ Disallow: /css/ Disallow: /db/ Disallow: /flash/ Disallow: /forms/ Disallow: /fpdb/ Disallow: /images/ Disallow: /jobform/ Disallow: /js/ Disallow: /lib/ Disallow: /logs/ Disallow: /miscellaneous/ Disallow: /popups/ # # list specific files robots are not allowed to index # # ###############################