logo

Grimgrains

[mirror] Plant-based cooking website <https://grimgrains.com/>

robots.txt (1114B)

    

  1. User-agent: AI2Bot
  2. User-agent: Ai2Bot-Dolma
  3. User-agent: Amazonbot
  4. User-agent: anthropic-ai
  5. User-agent: Applebot
  6. User-agent: Applebot-Extended
  7. User-agent: Bytespider
  8. User-agent: CCBot
  9. User-agent: ChatGPT-User
  10. User-agent: Claude-Web
  11. User-agent: ClaudeBot
  12. User-agent: cohere-ai
  13. User-agent: cohere-training-data-crawler
  14. User-agent: Crawlspace
  15. User-agent: Diffbot
  16. User-agent: DuckAssistBot
  17. User-agent: FacebookBot
  18. User-agent: FriendlyCrawler
  19. User-agent: Google-Extended
  20. User-agent: GoogleOther
  21. User-agent: GoogleOther-Image
  22. User-agent: GoogleOther-Video
  23. User-agent: GPTBot
  24. User-agent: iaskspider/2.0
  25. User-agent: ICC-Crawler
  26. User-agent: ImagesiftBot
  27. User-agent: img2dataset
  28. User-agent: ISSCyberRiskCrawler
  29. User-agent: Kangaroo Bot
  30. User-agent: Meta-ExternalAgent
  31. User-agent: Meta-ExternalFetcher
  32. User-agent: OAI-SearchBot
  33. User-agent: omgili
  34. User-agent: omgilibot
  35. User-agent: PanguBot
  36. User-agent: PerplexityBot
  37. User-agent: PetalBot
  38. User-agent: Scrapy
  39. User-agent: SemrushBot
  40. User-agent: Sidetrade indexer bot
  41. User-agent: Timpibot
  42. User-agent: VelenPublicWebCrawler
  43. User-agent: Webzio-Extended
  44. User-agent: YouBot
  45. Disallow: /