When people say "there are barely any kids," they're often describing the outcome of past policy choices, not a reason to avoid changing them