The EU is not a nation, and foreign policy is a bit of sovereignty several member states really do not want to give up. And France perhaps more than most.
Right, but it depends where. The EU does not say much about how France runs most of its overseas territories, including French Polynesia and New Caledonia. Less than 10% of France’s surface area (land+sea) is actually in Europe.