Google’s John Mueller recently advised the company’s mobile-friendly test doesn’t follow the rules written in robots.txt files.
This topic came up in a Google Webmaster Central hangout where a question was asked about the mobile-friendly test and its relation to crawling and indexing.
Here is the question that was submitted:
“If I can see my text in Google’s mobile-friendly test, can I ensure that Google doesn’t have a problem with reading and indexing my content and my pages?”
In response, Mueller said it’s correct that if the mobile-friendly test can render a page then that’s a sign it can be crawled and indexed just fine.
So, in addition to the mobile-friendly test, site owners should be using the inspect URL tool in Search Console to make sure everything is working as intended.
Hear Mueller’s full response in the video below, starting at the 28:36 mark:
One of the things to watch out for here is the mobile-friendly test – as far as I know – doesn’t follow the robots.txt rules.
If you need any help with your SEO or Internet marketing, please contact SPYDERwebmarketing.com, 833 377 9337 x 701 or firstname.lastname@example.org
Jim is a Senior Digital Marketing Strategist Spyder Digital and has over 19 years of experience in the field. His insight and ability to drive new business for his clients from the Internet is unparalleled.
About SPYDER, web marketing agency
We are a digital marketing company with a focus on helping our customers achieve great results from various Internet marketing services across several key areas. 833 377 9337
The team at SPYDER truly appreciates you stopping by to visit and check out our services. We understand there are many companies in the digital marketing arena today to choose from and we would like the opportunity to earn your business. We look forward to speaking with you about your goals and marketing needs and helping you achieve them.