Or don't follow anyone (or follow your friends if they think it's a nice social signal). Put all the interesting people in lists and view the lists in https://tweetdeck.twitter.com/ instead of the usual UI.
This is pretty much what I do, although tweetdeck can be a little overwhelming at times if you are a casual viewer. Scrolling through this thread it seems that lists are an underrated feature.
You do lose access to a few extras (like polls), but the tradeoff might be worth it to you.