# do not remove the /bt/ entry (needed to capture bad bots) User-agent: * Disallow: /bt/ Disallow: /com/ Disallow: /com/bt/ Disallow: /mcl/ Disallow: /mcl/bt/ Disallow: /mcl/embed/ Disallow: /mcl/images/ Disallow: /mcl/media/