SiteSmith

How Google finds a new website

Google finds a new website in three ways: by following a link to it from a page it already knows, by reading a sitemap that lists the site's pages, or by the owner telling it directly through a free tool called Search Console. After finding a page, Google visits it, reads it and decides whether to keep it in its index, the huge list of pages it can show in results. For a new small-business site this usually takes days to a few weeks, and there is no way to make it instant.

The three steps: finding, reading, keeping

It helps to know that "being on Google" is really three separate steps, and a page can get stuck at any of them.

  1. Discovery. Google learns that a page address exists. It has not looked at the page yet.
  2. Crawling. Google's automated visitor, often called Googlebot or a crawler, fetches the page and reads what is on it, much like a browser does.
  3. Indexing. Google decides whether to store the page in its index and what it is about. Only indexed pages can appear in search results.

Showing up for a particular search is a fourth thing again. A page can be indexed and still appear only when someone searches your exact business name. That part depends on many factors, and nobody can promise where a page will appear.

The oldest way Google finds pages is by following links, the same way you click from one page to another. Googlebot visits pages it already knows about, notices links on them and adds the linked addresses to its list of places to visit.

For a new small-business site, the useful links are the ordinary ones:

  • Your Google Business Profile. The website field on your profile is a link Google itself controls. Adding your site there is one of the first things to do.
  • Your social media pages. The website link on your Facebook page, Instagram profile or Nextdoor business page.
  • Directory listings such as your chamber of commerce, a trade association, Yelp or the Better Business Bureau. Directory listings and your website covers which are worth the time.
  • Local partners. A supplier's "where to buy" page, a venue's list of vendors, a church or school you sponsor.

You do not need many. One or two links from pages Google visits regularly are often enough for discovery. The point here is being found, not collecting links.

Inside your own site, links matter too. Google finds your service pages by following the menu and the links from your home page. A page that nothing links to, sometimes called an orphan page, may never be found.

Way two: a sitemap

A sitemap is a file on your site that lists the addresses of your pages, like a table of contents written for search engines. Most website builders and modern platforms create one automatically, usually at your address followed by /sitemap.xml.

A sitemap does not force Google to index anything. It simply makes sure Google knows every page exists, which matters most for new sites with few links pointing to them. What a sitemap is and whether you need one explains how to find yours.

Way three: telling Google directly

Google offers a free tool, Google Search Console, where a site owner proves they own a site and can then talk to Google about it. For a new site, two things there help discovery:

  • Submitting your sitemap, so Google reads your list of pages.
  • Requesting indexing for a page with the URL Inspection tool. You paste in the address of your home page and ask Google to crawl it.

Requesting indexing puts the page in a queue. It is not a button that adds you to results on the spot, and pressing it again and again does not speed things up. Google Search Console for small business owners walks through setting it up.

What Google looks at once it arrives

When Googlebot fetches a page, it reads the text, the headings, the page title, the links and the descriptions on images. It also checks a few instructions the site gives it:

  • Robots.txt, a small file that can tell crawlers to stay out of parts of a site.
  • A "noindex" tag, an instruction inside a page that says "do not put this page in search".

Many new sites are accidentally built with one of these blocking Google, often left over from when the site was being built in private. If a site has been live for weeks and still is not appearing at all, that is one of the first things to check.

Google also decides whether a page is worth keeping. A page with almost no text, or that repeats another page, may be crawled and then left out of the index.

Why it takes time, and how much

Google has no reason to rush to a brand-new site it has never seen. It visits sites more often once it knows they exist, have pages people link to and change from time to time.

Rough expectations for a new small-business site:

  • A few days to a couple of weeks for the home page to be found and indexed, once Google has a link or a sitemap.
  • Longer for the inner pages, especially on a site with many pages.
  • Longer still before the site appears for searches other than your business name.

How long it takes a new website to show up on Google goes into the timing in more detail.

What does not help

Owners are often sold ways to speed this up that make no difference or cause trouble:

  • Paying for "search engine submission". Google does not take submissions for a fee. Search Console is free.
  • Buying links. Paid links from unrelated sites can do harm.
  • Changing the site every day to attract attention.
  • Resubmitting the same page over and over.

When the new site replaces an old one

If your new site sits on the same domain as an old site Google already knows, discovery is faster, because Google already visits that address. The bigger task then is making sure old page addresses lead to the right new pages, so the place the old site earned is not thrown away.

What to do this week

  • Add your website address to your Google Business Profile and your main social media pages.
  • Find your sitemap by typing your address followed by /sitemap.xml.
  • Set up Search Console, submit the sitemap and request indexing for your home page.
  • After a week, check whether Google has your website.
  • Then give it time.

If you are planning a new site and want it to arrive with a sitemap, clear page titles and your old addresses forwarded, you can see your site rebuilt first before anything changes on Google.