It finally coming... mark your calendar.
This content isn't available right now
When this happens, it's usually because the owner only shared it with a small group of people, changed who can see it or it's been deleted.It seems that Google will ignore “noindex”. Make sure to change your vernacular — the correct term is ‘disallow’.
A note on unsupported rules in robots.txt
webmasters.googleblog.com
Official news on crawling and indexing sites for the Google indexIt does surprise me that this hasn’t been standardized yet. When disallowing content, it would be nice to know that everyone is playing by the same rules.
Google Wants to Establish an Official Standard for Using Robots.txt - Search Engine Journal
www.searchenginejournal.com
Google has proposed an official internet standard for the rules included in robots.txt files.We all knew it was coming soon.
Google Moves to Mobile-First Indexing by Default for New Websites - Search Engine Journal
www.searchenginejournal.com
Mobile-first indexing will be enabled by default for all new websites as of July 1, 2019.