Home > Internet, WebDev, Website > Removing cruft from Google via GoogleBot

Removing cruft from Google via GoogleBot

December 12th, 2005 Mark Leave a comment Go to comments

I submitted a request to Googlebot on 30th November to remove all pages relating to my /forums/ as there’s stuff still indexed/cached in Google that’s not been there for months

I noticed today that in the past couple of days the status of the request had changed to completed.. so I search google site:www.influenced.net and there’s still a lot of stuff that’s indexed under /forums/ which doesn’t exist.. so what the heck has been completed exactly?

I’m going to retry it via a rule to deny indexing the /forums/ folder in robots.txt and see what happens..

Edit: robots.txt seems to have done the trick

Categories: Internet, WebDev, Website Tags:
  1. No comments yet.
  1. No trackbacks yet.