PHY facing tap center of the transformer in the magnetics

In our PD PoE design we are using the DP83825I as PHY. After extensive tests we have found that the link is more reliable leaving the PHY facing tap center of the transformers unconnected, while the DP83825I datasheet (page 93) suggest to connect them to GND via a 0.1uF and 1uF capacitors. In my understanding the purpose of the GND connection is just to reduce the common mode noise so I am wondering if we can leave the TCT and RCT floating or is there any drawback?

Thanks