I may be having a brain fart moment at th emoment but shouldn't it be possible to restrict with firewall rules which hosts can hit a port forward. Basically I've created a port and under the firewall policies created a rules to allow it.
Does anyone have an example of this already set up?