# robots.txt for devrives.com # # One group for every crawler. A crawler obeys only the most specific group # that names it, so per-bot groups (Googlebot, Bingbot, …) would silently # drop the Disallow rules below for those bots — don't add them unless the # group repeats every rule. # # Everything public is crawlable. Pages that should stay out of the index # (legal pages, small category archives) carry meta noindex instead, since a # robots.txt block would hide that noindex from crawlers. User-agent: * Disallow: /api/ Sitemap: https://devrives.com/sitemap.xml #DaumWebMasterTool:3f3df13b96953a8b7a11955a81cc633762f54841fc99aa0f713ffd2dcdc77b88:TEcOMIBivQMU4H7qOlp5xQ==