NAS and PTP routing speed with PowerBeam AC between router and switch

I am running a network with the EdgeRouter LITE and the Edge Switch, with multiple VLANs.

If I would to separate the Edgerouter and the Edgeswitch, and bridge the lan port of the router with the Powerbeam AC, I know that I would have a bottleneck at the upstream side to the internet, but will that cause any slowdowns between my VLAN's?

I know that the Edgeswitch is a Layer 3 switch, but I also have some ToughSwitches in the network connected to the Edgeswitch. Attached is a simplified version of my networking setup.