# www.robotstxt.org/ # Allow crawling of all content User-agent: * #Disallow: /comment/* Disallow: /discloure/* Disallow: /events/*