# Next line allows all spiders User-agent: * # Next lines will stop access to various sub directories Disallow: /Includes Disallow: /IncludesReg Disallow: /IncludesSrch Disallow: /SiteImages