ADS8353-Q1: Can AINM_X be connected to a voltage that neither REFIO_X nor GND?

Hello,

I am using the example external voltage reference that implements the REF34-Q1 with the OPA2320-Q1 to supply a reference voltage to REFIO_A and REFIO_B. However, I wish to interface one of the ADS8353-Q1 channels with a sensor that will output a 0-5V signal to the AINP_A pin and its own separate 2.5V reference to the AINM_A pin. This 2.5V reference from the sensor is NOT the reference voltage given to REFIO_A, however it is still ~2.5V. Would this be appropriate, or is it that AINM_A  must be connected to REFIO_A  or GND?