.Google.com restricts robots.txt support to four areas, clarifying its standpoint on in need of support directives.Google.com just supports four certain robots.txt areas.Unsupported regulations in robots.txt will be actually overlooked.Look at bookkeeping your robots.txt files taking into account this update.