Robots.txt needed

[shubh]

Please check this is right or not

User-agent: Googlebot-Image
Disallow: /

User-agent: YandexImages
Disallow: /

User-agent: msnbot-MM
Disallow: /

User-agent: Googlebot-Mobile
Allow: /*wap
Disallow: /

User-agent: YandexImageResizer
Allow: /*wap
Disallow: /

User-agent: MediaPartners-Google
Allow: /

User-agent: *
Allow: /$
Allow: /*type=rss
Disallow: /*action
Disallow: /*wap
Disallow: /*.msg
Disallow: /*.new
Disallow: /*;
Disallow: /*PHPSESSID
Disallow:/credits
Disallow:/PHPSESSID
Disallow:/?PHPSESSID
Allow: /*board
Allow: /*topic
Allow: /
Disallow:/?sort=views
Disallow:/?sort=subject
Disallow:/?sort=starter
Disallow:/?sort=last_post
Disallow:/?sort=subject
Disallow:/?prev_next=next
Disallow:/?prev_next=prev
Disallow:/msg
Disallow:/reminder
Disallow:/?start=
Crawl-delay: 5
Clean-param: PHPSESSID /index.php
Host: www.yourdomain.com

[Illori]

are you trying to block the bots? if so you will block some with that. you should read www.robotstxt.org/ for more information about robots.txt.

[shubh]

Yes,
I am trying to stop robot because google shows duplicate description and title.

http://www.yourdomain.com/affiliates/affiliation-gives-me-less-money/?prev_next=next

http://www.yourdomain.com/affiliates/affiliation-gives-me-less-money/?prev_next=next

http://www.yourdomain.com/affiliates/?sort=views

http://www.yourdomain.com/affiliates/?sort=subject


Therefore i have these add today

Disallow:/?sort=views
Disallow:/?sort=subject
Disallow:/?sort=starter
Disallow:/?sort=last_post
Disallow:/?sort=subject
Disallow:/?prev_next=next
Disallow:/?prev_next=prev
Disallow:/msg
Disallow:/reminder
Disallow:/?start=

In the Vb bulletin,wp .It is clear for robots but in smf it is not clear.

[Illori]

by having

User-agent: Googlebot-Image
Disallow: /

you are blocking the whole bot so the rest of the text does not matter, read up on what robots.txt actually is and how to use it.

[shubh]

Confuse me, if the whole bot is stop than how the google show the duplicate meta description and title. According to you what will be my step.

[Illori]

i would say trash the robots.txt file unless you are willing to learn how to make one correctly, and just let things happen as i said before SEO is a joke and not worth your time.

[shubh]

I can' trash it .My website already go down from first page to third page. If i will trash it, i did not know what the rank.

[Illori]

it is not really in your control what the search engines do, if you think about it. the search engines have not told us what they look for how they rank websites. so just let things go and if you become more popular then you will go up in the search again.

[Arantor]

robots.txt has other uses that aren't SEO related. Certainly it can help exclude certain things from reputable search engines (which has a performance concern) and it can prevent duplicate content under certain circumstances (which IS a valid SEO concern)

I would ask, instead of whether to trash the file or 'whether it's right', better to figure out what you're trying to achieve, since this may be exactly what you want or it may be wrong, but in order to know that, we need to know what you're trying to do.

[shubh]

To avoid this

From the webmaster tools , i got this.

[Arantor]

Robots.txt files will not fix any problems with meta descriptions or title tags.

[shubh]

Robots.txt files will not fix any problems with meta descriptions or title tags.

As i have just send the print screen without click on Meta Tags and description.
They are like this only.

http://www.yourdomain.com/affiliates/affiliation-gives-me-less-money/?prev_next=next

http://www.yourdomain.com/affiliates/affiliation-gives-me-less-money/?prev_next=next

http://www.yourdomain.com/affiliates/?sort=views

http://www.yourdomain.com/affiliates/?sort=subject

Same Urls

[Arantor]

...those are supposed to have canonical URLs on them, though none of those are supposed to be picked up by search engines anyway (which is why I suggested to you to use a dedicated sitemap tool for SMF, rather than a generic sitemap maker that doesn't know about SMF's little oddities)

(Also, please do not PM me unless I have asked, thank you. Support should be publicly available so everyone benefits, not just you.)