Karen Challinor

UK

Company Director

so putting sensitive content in specific folders and using robots.txt to prevent search bots from looking in those folders isn't sufficient any longer is it ?

now we have to invent a new protocol and update all our websites to adapt to it do we ?

so basically what we are saying is that the people who designed the websites that charge for viewing the content, have found that they haven't catered for search engines indexing that content and providing direct links to it and instead of fixing the problem using the tools at hand they want to introduce a new standard so everyone else has to change their websites to suit them

please feel free to correct me if I've got this wrong