What is Indexing?

[nomi147]

If webpages included in your search engine have not been indexed by Google search, you can make the webpages more discoverable to Google by submitting a Sitemap. A Sitemap is an XML file that lists pages on your website and includes information about your webpages, such as when they were most recently updated, how frequently they change, and how important they are in relation to each other. To learn more about Sitemaps, see Selecting Sites to Search. If you do not want to use Sitemaps, you can add individual URLs of webpages you want Custom Search to index.

Google can index only webpages that can be accessed and crawled. Make sure that your site does not use robots.txt file or meta tags to block Googlebot from crawling pages that you want indexed.

On-demand indexing takes up to 24 hours to completely index your Sitemap or individual URLs. On-demand indexing indexes documents in a special index created for custom search engines. The documents indexed in on-demand index may not appear in Google.com search results until Google.com indexing takes place for these documents.

On the Indexing tab, you can view information about the indexing status of your search engine and Sitemaps. If you have Google Site Search, this tab also includes information about your plan quota and the approximate number of pages indexed. You can request indexing for up to a certain number of webpages for the search engine. If you have upgraded your search engine to Google Site Search, you have higher limits that vary according to your account level. More information about on-demand quotas. You can also use this process to submit updated PageMap data for your URLs.

As the web pages that you previously submitted for on-demand indexing move into the regular Google.com index, your on-demand indexing quota gets freed up for you to submit additional documents for on-demand indexing.