# --------------------------------------------------------------------------- # robots.txt for https://panel.vyomcloud.com/ (WHMCS client + billing portal) # # UPLOAD TO: the document root of the panel subdomain on cPanel # (usually ~/panel/ or ~/public_html/panel/ — the folder that # serves panel.vyomcloud.com), NOT the main site's public_html. # # WHY: this host is a transactional application, not marketing content. Every # URL here is either authenticated, a duplicate of a www.vyomcloud.com landing # page, or an infinite crawl trap (cart steps, ticket views, session URLs). # Letting search engines and audit crawlers loose on it produces redirect # chains, thin/duplicate pages and keyword cannibalisation against the main # site's own pricing and product pages. # # NOTE: this replaces the current file, which only blocks "meta-externalagent" # and therefore leaves the whole portal open to Google, Bing and Semrush. # # Last updated: 2026-07-25 # --------------------------------------------------------------------------- # Google Ads landing-page checker keeps full access, so that any ad pointing # at a /store/ or /cart.php URL is still approved. AdsBot ignores "*". User-agent: AdsBot-Google Allow: / User-agent: AdsBot-Google-Mobile Allow: / # Everything else: stay out. User-agent: * Disallow: /