"Here Matt used the terminology "Uncrawled reference" http://www.stonetemple.com/art... Just to confuse matters John Mu does say "for indexing if we don't crawl" https://plus.google.com/107576... I think what Matt says is much cleaner... why? Because then if a URL is "indexed" it means it has been crawled, and then a meta "noindex" or x-robots noindex can remove it." - Andy Beard