Quote Originally Posted by dmantione
It's better to do it a bit more controlled. You want PGD to appear in Google, but you don't want it to browse all user profiles or browse the reply page for each topic.
I'm only blocking it temporarily, until I have time to sit down and decide which sub-directories and pages it can access. Before today it and other bots had access to everything, which literally consumer GBs of usage.