Googlebot Updates About Crawling 15MB Webpage
Are you facing trouble in your website ranking? The solution is you should make sure that the top 15 MB of the page can be crawled and indexed by Googlebot. According to the updates on the Googlebot help page, Googlebot will only crawl the first 15MB of a website before stopping.
Therefore, if you want to make sure that Google ranks your website correctly, make sure that the top 15MB of the page can be crawled and indexed by Googlebot.
What’s Google added to the Googlebot Help Document?
The following section has been added by Google to the Googlebot help document:
An HTML file or other compatible text-based file’s first 15MB of material can be crawled by Googlebot. Googlebot stops crawling after the first 15MB of the file and only analyses the first 15MB of material for indexing.
Resources like pictures, videos, CSS, and JavaScript that are referred to in the HTML are retrieved individually.
Importance of this Update in SEO
To give it weight and consideration, important content should be at the top of web pages for Googlebot. This implies that the code must be organized so that the top 15 MB of any text-based or HTML file contains SEO-relevant data. Additionally, if practical, pictures and videos should be compressed rather than simply encoded into HTML.
How Can You Find Out a Page’s Dimensions?
There are other options as well but you can use your own browser and its Developer Tools. Launch the Developer Tools, and then choose the Network tab after loading the website as usual.
The requests should be visible in your browser when you reload the page. What you’re searching for should be in the top request. It includes the page’s byte count in the Size field. The idea of having material on a page isn’t used for indexing. It may seem worrying in principle. However, in reality, 15MB is a considerable amount of HTML.
Photos and videos are acquired independently, according to the Google statement. The 15MB limit solely applies to HTML files. Unless you were publishing entire volumes’ worth of content on a single page, it would be impossible to exceed that limit with HTML.