What Is Indexing?
Indexing is the organization of information that occurs after crawling which allows pages to be seen on search engines. However, your page must be able to be crawled before indexing can occur. Therefore, it is important to have all your website pages available for crawling.
When searching at the most basic level, Google’s algorithms will analyze your search terms in the index to find appropriate pages for you. If you are looking for ‘computers’, it is likely that you are also searching for pictures, videos, a list of different brands, etc. Google’s indexing systems will note many different aspects of pages such as videos, pictures, and when they were published to provide potential visitors to your site valuable content.
By having more control over your domain authority, the more likely search engines will be able to crawl and index your website.
Levels Of Indexation
- Stored Permanently in the Main Index
- Stored Temporarily in the Main Index
- Stored in a Supplemental or Secondary Index
- Stored in a Specialized/Vertical Index Only
- Crawled, But dropped from Index.
- This is often due to low page rank or removal of citations and/or links.
- Seen by Crawler, but never crawled.
- A possible reason for this is due to the page being linked to unimportant pages.
- Never Seen
- This happens frequently with new websites/blogs/pages due to the absence of external links.
There are two definitive ways to ensure that an important page or set of pages is included in Google’s main indices:
- By checking your traffic logs, you can see if queries are actively sending the page traffic.
- Perform queries that show the page appearing in the results.
For more information on how you can help Google to crawl the right content on your website, please visit https://support.google.com/webmasters/topic/4617736?hl=en&ref_topic=4589290