Removing cruft from Google via GoogleBot
I submitted a request to Googlebot on 30th November to remove all pages relating to my /forums/ as there’s stuff still indexed/cached in Google that’s not been there for months
I noticed today that in the past couple of days the status of the request had changed to completed.. so I search google site:www.influenced.net and there’s still a lot of stuff that’s indexed under /forums/ which doesn’t exist.. so what the heck has been completed exactly?
I’m going to retry it via a rule to deny indexing the /forums/ folder in robots.txt and see what happens..
Edit: robots.txt seems to have done the trick