If I create a site that serves a world of unique, useful content to Google, but locks out everyone else completely, do you want that content indexed? Is it really on the web? The search result only serves to annoy you into thinking there's anything to find.