No, that will not make difference because your ARIES is working as a slave, most workload to sync different devices are on the master device.
I think we need to isolate the problem and see if it is caused by network or processing power. First of all, I need to know if the drop out occurs on both master and slave device or only one of them. Second, I want to know if this happens on higher sampling rate file only or even it does not matter with the sampling rate. Last, I want to see a result by disabling bit-perfect option when you create the group, that will actually add processing load for them master device (downsampling process) but reduce load on the network since everything is on 44.1/48.