OK
https://www.redditstatic.com/robots.txt
Websites
Runtime: 314ms
On November 04, 2025, 10:59 AM UTC, https://www.redditstatic.com/robots.txt was accessible when tested on AS34511 in Spain.
Failures
HTTP Experiment
null
DNS Experiment
null
Control
null
DNS Queries
Resolver:
127.0.0.2
Query:
IN A www.redditstatic.com
Engine:
system
Name
Class
TTL
Type
DATA
@
IN
A
151.101.133.140
TCP Connections
Connection to 151.101.133.140:443 succeeded.
HTTP Requests
URL
GET https://www.redditstatic.com/robots.txt
Response Headers
Accept-Ranges:bytesAlt-Svc:h3=":443";ma=2592000;persist=1,h3-29=":443";ma=2592000;persist=1,h3-27=":443";ma=2592000;persist=1Content-Length:567Content-Type:text/plainDate:Tue, 04 Nov 2025 10:54:16 GMTNel:{"report_to": "w3-reporting-nel", "max_age": 14400, "include_subdomains": false, "success_fraction": 0.02, "failure_fraction": 0.02}Report-To:{"group": "w3-reporting-nel", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting-nel.reddit.com/reports" }]}, {"group": "w3-reporting", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting.reddit.com/reports" }]}, {"group": "w3-reporting-csp", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting-csp.reddit.com/reports" }]}Retry-After:0Server:snooservVary:OriginVia:1.1 varnish
Response Body
User-Agent: * Disallow: / Allow: /desktop2x/img/favicon/* Allow: /favicon.ico Allow: /icon.png Allow: /new-icon.png Allow: /desktop2x/img/social-sharing/* Allow: /talk/assets/social-sharing/* Allow: /marketplace-assets/* Disallow: /ads/* Disallow: /h3-opt-in Disallow: /h3-opt-out User-agent: Googlebot User-agent: AdsBot-Google User-agent: AdsBot-Google-Mobile User-agent: AdsBot-Google-Mobile-Apps User-agent: Googlebot-Image User-agent: Googlebot-Video User-agent: Applebot User-agent: ClarityBot Disallow: User-agent: bingbot User-agent: MSNBot-Media Allow: /
Resolver
Resolver ASN
AS0
Resolver IP
127.0.0.2
Resolver Network Name
Report ID
20251104T104541Z_webconnectivity_ES_34511_n4_oVk0TeKqecPbmTtm
Platform
windows
Software Name
ooniprobe-desktop-unattended (3.10.0-beta.3)
Measurement Engine
ooniprobe-engine (3.10.0-beta.3)