# Tells Scanning Robots Where They Are And Are Not Welcome # User-agent: can also specify by name; "*" is for everyone # Disallow: if this matches first part of requested path User-agent: * # applies to all robots Disallow: /le_cycliste/ Disallow: /vbq/ Disallow: /house/ Disallow: /cx/team/ Disallow: /tshirts/ Disallow: /tshirts.html