I was a regular user of the sf library until we found a dead bedbug in a book. It's just not worth the hassle of potentially infesting my apartment. Also, the bathrooms there are foul. I guess it's nice that street people have a bathroom they can use but the only way to describe it is rural western gas station. That killed lingering at the library.
Did you complain to a librarian about the restrooms? That is a cleaning issue, same as a busy airport. The library belongs to all local residents, chip in and help make it the space where you would like to linger. Bathrooms can be cleaned. The rest of the building and books are wonderful.