############################### # # http://www.actualitedulivre.com/rss/fluxrss.xml User-agent: * User-agent: Googlebot User-agent: Yahoo User-agent: msnbot User-agent: Accoona-AI-Agent User-agent: MSRBOT User-agent: VoilaBot # # list folders robots are not allowed to index # Disallow: /includes/ Disallow: /img/ Disallow: /Scripts/ Disallow: /stats/ Disallow: /crm/ # # list specific files robots are not allowed to index # # # ###############################