Noindex Nofollow

[sixbhsw]

Hi All,

I had put robots.txt file in my site and tried to exclude contents of a folder, e.g. test/. But I could not do it and google is still reading /test/1.html and so on. Can anyone please suggest me where I did the mistake?

Thanks in advance...

[JohnG]

It looks like you're trying to exclude specific files in the robots.txt rather than directories. Also, it will take some time before the search engines drop these from their indexes.

[mark_s]

A few things you might double check/try:

1. Create 'robots.txt' in root level (not in a folder)
2. Make a it a plain text file. On page editor, click 'SEO Options'. For 'Display this page within the CMS Layout?' setting, select No.

[Poker Sponsor 2-0]

Hi there,

I'm sure if you are still struggling to get it sorted that if you post the urls you would like blocked then someone will kindly give you the correct snippet to use.