User-agent: * Allow: / Disallow: /*CR-Dokumentation.pdf$ User-agent: GPTBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: magpie-crawler Disallow: / User-agent: ia_archiver Disallow: / User-Agent: omgili Disallow: / User-Agent: omgilibot Disallow: / User-agent: Baiduspider Disallow: / User-agent: AhrefsBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Yeti Disallow: / User-agent: SemrushBot Disallow: / User-agent: sentibot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Bytespider Disallow: / User-agent: SirdataBot Disallow: / User-agent: LCC Disallow: / User-agent: TurnitinBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: dotbot Disallow: / Sitemap: https://www.11freunde.de/sitemaps/news-de.xml Sitemap: https://www.11freunde.de/sitemap.xml # Legal notice: 11freunde.de expressly reserves the right to use its content for commercial text and data mining (ยง 44b Urheberrechtsgesetz). # The use of robots or other automated means to access 11freunde.de or collect or mine data without the express permission of spiegel.de is strictly prohibited. # 11freunde.de may, in its discretion, permit certain automated access to certain spiegel.de pages, # If you would like to apply for permission to crawl 11freunde.de, collect or use data, please email syndication@11freunde.de