In this article, we’ll explain how subdomains are treated in Ubersuggest’s Site Audit, why they may appear in your audit reports, and what steps you can take to minimize or block them using the robots.txt file.
While Ubersuggest doesn’t currently offer a built-in way to exclude subdomains from being scanned, there are still ways to control crawler access and keep your audit reports focused on what matters most.
Can I Exclude Subdomains from Ubersuggest Site Audit Reports?
Ubersuggest’s Site Audit feature scans your domain for SEO issues, and by default, it may also crawl any associated subdomains. Unfortunately, there's no feature available to manually exclude subdomains within the tool settings.
This means SEO issues from your subdomains (like blog.example.com or shop.example.com) might show up in your audit report along with your main site, which can make the results a bit confusing or harder to read.
How to Minimize Subdomain Data in Your SEO Audit
If you’d prefer that certain subdomains or directories are not included in the audit results, you can use a robots.txt file to block crawlers from accessing them. While this won’t remove them entirely from the audit (they may still appear as "blocked"), it helps control how much content gets analyzed.
Step-by-Step: Blocking Subdomains or Pages Using robots.txt
1. Access or Create Your robots.txt File
Make sure the file is located in the root directory of your main domain (e.g., www.example.com/robots.txt).
2. Add a Disallow Directive
To block an entire subdomain or specific directory from being crawled:
User-agent: *
Disallow: /example-subdomain/
To block a specific page:
User-agent: *
Disallow: /example-page.html
This tells bots not to crawl the specified paths, but remember: these URLs may still be detected and flagged as blocked, not removed.
3. Save and Upload the File
Once updated, upload your robots.txt file to your website’s root directory.
What Is a robots.txt File?
The robots.txt file is a small but powerful tool that gives instructions to search engine crawlers about which parts of your site they are allowed to access. It uses rules like Disallow or Allow to guide crawler behavior.
Located at the root of your domain, it’s a key part of your technical SEO strategy — helping improve crawl efficiency, protect sensitive content, and keep audit reports clean and focused.
Learn More About Ubersuggest's Site Audit Tool
To get the most out of your audits, check out these related guides:
We're here to help! Reach out to our support team anytime by clicking on the ¨Help¨ button at the end of this page. We love hearing from our users and are happy to assist.