That's specifically reverse image search, I find that image search itself has gotten much better at generic search terms.
I agree that the generic results on reverse search are annoying, but my guess is that it isn't replacing exact results, but rather giving you something when there would've been no results at all. If you search for an exact frame that does exist, it usually finds it correctly.
Google Search for DIY project images: Get 90% Pinterest results that end up just linking to a random machine generated page with garbage text and a few tangentially related pictures.
Google Search for someones Instagram handle: Get one Instagram result and endless pages of sites that scrape Instagram and have the person's profile interspersed with ads.
I agree that the generic results on reverse search are annoying, but my guess is that it isn't replacing exact results, but rather giving you something when there would've been no results at all. If you search for an exact frame that does exist, it usually finds it correctly.