# Robots.txt for Inburgering.org # Updated for Meta verification and social sharing # Allow Meta crawlers for social sharing and verification User-agent: facebookexternalhit Allow: / User-agent: meta-externalads Allow: / User-agent: meta-externalagent Allow: / User-agent: meta-externalfetcher Allow: / # Allow all search engines to crawl the site User-agent: * Allow: / # Sitemap location Sitemap: https://inburgering.org/sitemap.xml # Note: All search engines can now crawl and index the site # Meta crawlers continue to have access for social sharing and verification