Expunge Cache
Wednesday, September 3rd, 2008
Google.com
Yahoo (Slurp)
Live.com
Teoma, (the engine that powers Ask’s search)
Usually when the Ask.com spider encounters a 404 page, or a Directory Denied Server level URI request response, the bot will remove it from it’s listings.
Robots.txt
you also want to add a definitive Disallow instruction for that directory in your top level website robots file for your website.
Meta Follow
If you have access to append you can also instruct per page request robot instructions if you want to get this granular. (note: this is not always effective).