TVTropes Now available in the app store!
Open

Follow TV Tropes

Following

Place anti crawler code in source/history pages coding?

Go To

deuxhero Micromastophile from FL-24 Since: Jan, 2001
Micromastophile
#1: Jun 5th 2011 at 11:25:49 AM

I recall hearing that making search engines not list pages was a simple matter once. Would it be possible to do it for these pages? The results are always quite redundant.

Korodzik Since: Jan, 2001
#2: Jun 12th 2011 at 5:01:16 AM

You can just add -"action=source" -"article_history" -"action=diff" to your Google searches.

There are things that can only be found in source code (potholed wicks and URLs) and histories (recently deleted examples). Placing anti-crawler codes on these pages would make these things impossible to find.

edited 12th Jun '11 5:01:43 AM by Korodzik

Add Post

Total posts: 2
Top