Well, you're definitely right that competent companies help a lot, but the government still does a lot of technical work in Five Eyes countries and in countries like China and Russia that have very strong mass surveillance too the government does a lot of the job.

I think the answer is different - the reason is because it is an 'Industrial Complex' regardless of any actual industry. Essentially if it works in a feedback loop of some sort whether it is 'more draconian security theater to help their career' or funneling money to donors then utility is irrelevant. If it is an end to itself then it is always 'competently done' even if it is a millstone around the neck of a nation.

How do you measure competence? China plays whack-a-mole with its population. They certainly haven't eliminated dissent. They have the world's largest army as the only real backstop against opposition.

As a Chinese, I say Chinese government is really bad at PR and competent in dealing with issues given the circumstances. As you know China has been living through something comparable to 1920 - 2000 in last 20 - 30 years. Any thing you just think would work will stop working the next year, they are far from perfect, but I think they are doing a pretty good job so far.

I think it is less about competent. It is actually are you willing to set out policy to solve the problem but lose your popularity? Is government is ready to make the hard choice? People can only do that during war time.