# # Robot control file; use to restrict automated indexing. # User-agent: * #Disallow: /directory/ #Disallow: /filename