# All robots will spider the domain User-agent: * Disallow: # Disallow directory cgi-bin User-agent: * Disallow: cgi-bin # Disallow directory _private User-agent: * Disallow: _private # Disallow directory _vti_log User-agent: * Disallow: _vti_log # Disallow directory _vti_log User-agent: * Disallow: chat