# robots.txt fuer http://www.ombelico.de # Alle Robots User-agent: * Disallow: /images/ Disallow: /cgi-bin/ Disallow: /wp- Disallow: /trackback/ Disallow: /rss/ Disallow: /comments/feed/ Disallow: /page/ Disallow: /date/ Disallow: /comments/ Disallow: */feed/$ Disallow: */feed/rss/$ Disallow: */trackback/$ Allow: /feed/ # Robots der Spamer muessen leider draussen bleiben User-agent: WX_mail/2.000 User-agent: EmailCollector User-agent: WhoWhere User-agent: Roverbot User-agent: ActiveAgent User-agent: EmailSiphon User-agent: LinkWalker User-agent: baiduspider Disallow: / # Yahoos Crawler ausbremsen User-agent: Slurp Crawl-delay: 20 Disallow: /tags/