Search engines can't show people your website if they don't know that it exists.
If you want your website to show up on Google and other search engines, you need to get it indexed first. The best way to do that is by submitting your site to them directly. Telling Google and Bing where to find your website just takes a few steps, and it allows you to compete for valuable organic traffic.
Read on to learn how to get Google to index your site and what to do if it still doesn't show up in search after you submit it.
Why Do I Need to Request Indexing for My Website?
Websites don't just appear on search engines like Google and Bing.
Search engines use special programs, known as bots or web crawlers, to explore the internet. These bots compile lists of all the sites they find and place them in search engines' indices. They crawl the internet using links from pages that are already in the index to discover and catalog new ones.
But the bots may never find your site if it doesn't have any links from pages in the index.
Websites and pages that aren't in Google's index will not appear in the search results. That's a massive missed opportunity for bringing potential clients to your website.
The good news is that search engines know this is a problem. They allow website owners to submit their websites manually and request indexing. All you need to do is tell Google that your site exists, and it will send out bots to crawl it.
Besides the fact that a manual submission adds your site to Google's index, there are a few other reasons to do it.
It's Easy
The process of submitting a site to a search engine is simple. And the benefits of being in the index and appearing in search far outweigh waiting for bots to find your site by chance.
It's Important for SEO
Indexing your site also speeds up the process of ranking for important keywords.
Bots might not discover everything on your site on their own. When you manually submit your website, it becomes easier for major platforms to start cataloging the pages on your site and pairing them with keywords. Your submission also helps search engines with details about your site that they may not pick up otherwise, like the importance of each page.
It Gives You Useful Data
You have to use free tools like Google Search Console and Bing Webmaster Tools to submit your site. Both of these platforms have useful dashboards that provide you with data on your site's performance in search results.
These reasons aren't to say that submitting your site is an SEO silver bullet.
Your website isn't going to rank for every keyword you want the minute it's indexed. It takes time for most sites to appear on the first page for primary search terms. And it can take months to reach the first page in intensely competitive niches, like SEO for lawyers.
But indexing your is the first step to reaping the benefits of ranking in search.
If you've never requested indexing for a website before, the steps below will walk you through how the indexing process works.
1. Find Your Website's Sitemap
The first step in getting search engines to crawl your website is telling them that you exist. You can do this by submitting a special file, called a sitemap, to them. When you submit this file to Google and Bing, they'll begin their own crawling and indexing processes.
If you already know where your sitemap is, you can copy its URL and move on to the next steps.
If you don't know if you have a sitemap or where it is, the methods below will walk you through how to find it.
What is an XML Sitemap?
An XML sitemap is a file hosted on your website that lists all of your live page URLs.
You can think of it as a roadmap that helps search engines index your website by making it easy to navigate all your pages. They're written in a format (eXtensible Markup Language) that's easy for web crawlers to read and understand. Your sitemap gives crawlers a starting point for navigating and indexing your site instead of crawling random links.
There are three different methods you can use to find your sitemap.
Method 1: Check yourdomain.com/sitemap.xml
The simplest method is to look in the most obvious place.
Most websites have their sitemap on a URL that follows the root domain. All that means is if your site is <span class="inline-code">example.com</span>, then your sitemap is most likely located at <span class="inline-code">example.com/sitemap.xml</span>.
Here’s how to check if that’s where your sitemap is located:
If you don’t find your sitemap using this method, it doesn’t mean it doesn’t exist. It could be on an unusual URL.
Method 2: Check Your robots.txt File
<span class="inline-code">Robots.txt</span> is another file on your website that gives instructions to web crawlers. Instead of being a roadmap, though, these files tell crawlers what pages they should and should not visit.
Many <span class="inline-code">robots.txt</span> files will list the sitemap in addition to setting boundaries for crawlers. Here’s how you can check yours:
<span class="inline-code">Robots.txt</span> files don’t always list the location of a sitemap. If you don’t see your sitemap in this file, there’s another method you can use.
Method 3: Use Advanced Search Operators
If the last two methods didn't turn up your sitemap, it might be because it doesn't follow the standard naming convention.
Google's advanced search operators may be able to help you find sitemaps with unconventional names. The walkthrough below demonstrates how to use this method.
This advanced search operator below tells Google to show you all pages on example.com with the word “sitemap” in the URL.
<pre><span class="inline-code">site:example.com inurl:sitemap</span></pre>
If that doesn’t work, “sitemap” may not be in the filename at all. You can use the following advanced search operator to tell Google to show you all of the XML files on your site instead.
<pre><span class="inline-code">site:example.com ext:xml</span></pre>
Your website may not have a sitemap if you cannot find it through any of these three methods. You'll need to create a new sitemap before you can move on to the next steps.
If your website is on WordPress, there are plenty of plugin options available that can generate sitemaps for you. Some options include SEOPress, Rank Math, or Yoast SEO.
Other content management systems, like Webflow, have built-in sitemap generators.
Finding your sitemap is usually the hardest part of requesting indexing. Once you've found your sitemap, submitting it to the major search engines is a breeze.
2. Submit Your Website to Google Search Console
You'll need to use Google Search Console to request a site crawl from Google.
Go to your website's Google Search Console property and then select the Sitemaps menu from the sidebar. Then, enter your sitemap and click the "request indexing" button. Use the walkthrough below to see how this process works.
If you haven't set up Google Search Console for your website, you'll need to create an account first. You'll need to log into the tool here with a Gmail account. Then you'll need to verify that you own the website and set up a new property following this guide from Google.
How to Submit Multiple Sitemaps to Google
Some websites will have more than one sitemap. For example, a lawyer may have separate sitemaps for their blog posts and practice area pages.
Google Search Console makes submitting multiple sitemaps easy. For each of your sitemap URLs, follow the process outlined in the last walkthrough.
How to Submit a Single Web Page to Google
Google will schedule your site for crawling as soon as you submit the sitemap Google Search Console and at regular intervals.
But if you publish a new page or post between crawls, you'll want to make sure it lands in Google's index, too.
You can manually submit new pages through Google Search Console by entering the single URLs into the search bar at the top of the tool. Here's a walkthrough for requesting a crawl for a single page:
Submitting URLs this way is perfect when you have one or two new pages that you want Google to index. It's not a solution for getting your whole site indexed, though.
It's just a matter of time until Google indexes your site after you submit your sitemap through Search Console. In the meantime, you can request a crawl from other search engines.
3. Submit Your Website to Bing
Submitting a website to Bing is a lot like submitting a sitemap to Google. You'll just need to use Bing Webmaster Tools instead of Google Search Console.
If you already have a Bing Webmaster Tools account, and you've verified that you own the website, you can:
- Log into Bing Webmaster Tools
- Select the Sitemaps option from the left-hand sidebar
- Click on the Submit Sitemap button
- Enter your sitemap URL into the popup dialog box that appears on your screen
- Click Submit
You'll need to repeat this process for each of your sitemaps. Bing will then schedule a crawl of your website.
4. Submit Your Website to Yahoo
Submitting to Yahoo is the easiest of them all because there's nothing for you to do.
Bing is the search engine that powers Yahoo. Anything that Bing indexes will show up in Yahoo search results.
Is Google Indexing Your Site? Here's How to Check.
Advanced search operators can show you if Google has indexed a new page on your site.
All you need to do is copy the URL that you want to check and use the <span class="inline-code">site:</span> search operator in Google. Here’s a walkthrough with an example:
It can take anywhere from a few minutes to several days for Google to index a new page. Don't worry if the advanced search doesn't turn anything up right away. You can check back with the same method in a few days to see if the page has been indexed yet.
Note: the <span class="inline-code">site:</span> search operator works on Bing, too. You can use the same method to see if your page is in Microsoft’s index.
You can also check in Google Search Console to see all the pages on your site that it discovered while crawling.
What's useful here is that the tool can show you both indexed pages and all the pages Google couldn't index. Follow this walkthrough to see which pages are indexed in Google Search Console:
Search Console's page indexing report is a helpful tool for finding potential indexing issues with your site in between any technical SEO audits. But if you see a single page or set of pages that Google can't index, you may need to do a deep dive.
What to Check if Your Website Isn't Indexed
If Google can't index your website or a page on your website, there are three common issues to check.
Some Web Pages are Flagged as noindex
Google will not index pages that have the noindex meta tag in their HTML code.
This is a useful tag if you don't want a page to show up on Google. For example, an appointment confirmation page that shows up after a visitor submits a free consultation form doesn't need to be in the search results.
But these tags are a real problem if you want a page to appear in searches.
The easiest way to check for this issue on the page level is to use DevTools in the Chrome browser. Go to the page that you want to inspect, and then follow the walkthrough below.
In a similar vein, nofollow links are a type of meta tag applied to links that tell search engines to ignore the target page. This can help you avoid associating your site with low-quality backlinks, but using them excessively within your site can hinder Google's discovery of your pages. Be cautious with nofollow links and reserve them for specific circumstances where you intentionally want to abstain from linking to the page.
In some scenarios, you might want to block Google's crawlers from certain pages that don't want to show up in Google search results. For example, maybe there are some pages hosting duplicate content or low-quality pages that you don't want to be part of the Google index.
However, all your pages should provide high-value information to users, enhancing your website's overall standing in search engine results.
Your robots.txt File Is Blocking Search Engines From the Site
If you see that your entire site, or large sections of it, can't be indexed, you may have an issue with your robots.txt file.
Go to your <span class="inline-code">robots. txt file</span> and check that your site isn't blocking Googlebot. Robots.txt instructions that block Googlebot look like this:
The code above tells Google that it should not crawl any of the subfolders on your site.
You'll need to go to your SEO plugin (Yoast, SEOPress, Rank Math, etc.) to remove this from your robots.txt file if you're on WordPress. If you're on Webflow, the options to change this are under the SEO tab.
Then, you can resubmit your sitemap to Google Search Console for indexing.
Your .htaccess File Is Blocking Search Engines From the Site
Sites that run on an Apache-based server have a file called <span class="inline-code">.htaccess</span> that gives web admins control over various server settings. An issue with this file can cause indexing issues. You’ll need access to the server your website lives on to check and adjust this file.
If you can get to the <span class="inline-code">.htaccess</span> file, look for the following code:
<pre><span class="inline-code">Header set X-Robots-Tag "noindex, nofollow"</span></pre>
Removing the <span class="inline-code">noindex</span> and <span class="inline-code">nofollow</span> parts will allow Google and other search engines to access your site.
An issue with your <span class="inline-code">.htaccess</span> file is the most technical of the three common indexing issues. If you feel that it’s outside of your skillset, it may be time to contact someone with a technical SEO background.
What if Your Website Is Indexed but Isn't Ranking?
Just because your site is in Google's index does not mean it will rank.
Getting your site indexed is important. Making sure that Google can index your pages is a prerequisite for appearing in the search results. These are the table stakes to getting organic search rankings.
But ranking well on Google takes more than just indexing.
One of the biggest ranking factors is whether your website content matches the searcher's intent. Google's goal is to provide people with results that answer their questions and satisfy their needs.
You stand a better chance of ranking when you create content that matches the intent for each keyword you target. Performing keyword research can help you find high value keywords to create content around. It can also point you in the right direction for each keyword's intent.
Understanding on-page optimization can help you improve the content you already have for both people and search engines.
Finally, link-building activities can help your site attract links from relevant, authoritative sources. Google sees links as endorsements of your site. Authority from relevant sites passes to your own and can improve your rankings.
A strong internal linking structure is essential in enabling Google to index your site for its search results. Relevant pages are easily identified by search engine crawlers, so remember to add internal links from your existing blog posts or pages to important new pages.
However, be cautious with low-quality pages or duplicate pages with the same content — these can be a waste of your site’s crawl budget. Consider using noindex tags or de-indexing those pages altogether using the URL Inspection tool in Google Search Console. This tool can provide real-time feedback on the indexing status and nofollow internal links status of any page on your website.
By adding powerful internal links to your most important pages, you can signal to Google the pages that you want indexed. This strategy also helps with Google Discover, linking often-visited pages to relevant blog posts or pages that Google may choose to feature.
You can use the "Links Report" from the Search Console or Google Analytics to find information about external and internal links to a particular page of your site. This can be especially helpful for identifying orphan pages—pages without any internal links. If you have a WordPress site, you can also use the WordPress Dashboard to identify these pages.
If you want a DIY guide to all of these activities and more, check out our free SEO checklist here.
Wrapping Up
Getting your website indexed by search engines is vital if you want to grow your organic traffic.
Indexing is the first step to getting your website in front of potential clients. If your website isn't in Google's index, people will not find you in the search results.
The best way to get your site indexed is by manually submitting your site to search engines.
But getting your site indexed does not mean you'll start ranking for keywords right away. Getting your website indexed is your ticket to enter the race. Once in the race, continuous SEO efforts can help you win it.
To learn more about what your law firm can do to win that race, check out our guide to SEO for lawyers.
