# Robots.txt - BSS Seguridad # https://www.bss.com.ar/robots.txt User-agent: * Allow: / Crawl-delay: 1 # Sitemaps Sitemap: https://www.bss.com.ar/sitemap.xml # LLM / AI crawlers - bienvenidos, con rate limit User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-Web Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: cohere-ai Allow: / User-agent: CCBot Allow: / User-agent: Bytespider Allow: / # Bad bots - bloquear User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: BLEXBot Disallow: / # LLM endpoints explícitos # Ver también: /llms.txt (estándar llmstxt.org)