# All robots will spider the domain User-agent: * Disallow: /css/ Disallow: /gfx/ Disallow: /inc/ Disallow: /downloads/ Disallow: /pgs/ Disallow: /tpl/ Disallow: /js/ Disallow: /pgs/ Disallow: /pms/ Disallow: /Projects/ Disallow: /Customers/ Disallow: /Documents/ Disallow: /phpAdmin/ Allow: /OS/