User-Agent: ChatGPT-User User-Agent: anthropic-ai User-Agent: GPTBot User-agent: Google-Extended User-agent: Bytespider User-agent: CCBot User-agent: Diffbot User-agent: omgili User-agent: Amazonbot User-Agent: AdsBot-Google User-Agent: Mediapartners-Google User-Agent: AdsBot-Google-Mobile User-Agent: adidxbot User-Agent: FacebookExternalHit User-Agent: Twitterbot User-Agent: LinkedInBot User-agent: yandex Disallow: / User-Agent: * Disallow: /links/ User-Agent: * Disallow: /.well-known/ User-Agent: search.marginalia.nu Disallow: Sitemap: https://archaeoramblings.com/sitemap.xml