User-agent: *
Disallow: /websearch
Disallow: /web?
Disallow: /websnapshot.do?
Disallow: /sohu?
Disallow: /websearch/
Disallow: /sogou?
Disallow: /sohu/
Disallow: /site?
Disallow: /xml?
Disallow: /express/