Technically IP doesn't have ports. TCP and UDP (and others) individually have the concept of port. So it makes sense if you want a port filter it is a TCP specific rule.

...of course it is common enough that it would make sense to abstract over the different protocols that have more or less the same concept of ports.