RT @screamingfrog: Robots.txt prevents bots from accessing the page, not it's inclusion in the SERPs. Never has. +1 just provides the link. Which does suck.