I'm running into an issue with the PCM1861 running as I2S slave. In a certain operation mode of our product, our main microcontroller (I2S master) will repeatedly briefly stop the I2S clock. When this happens, I observe that the input signal line briefly dips to ground (about 1 ms). If other devices are connected to the same input line, a popping noise is heard, which is undesirable.
In the screenshots below, the upper trace is the audio input signal line (directly at the PCM1861 input), the bottom trace is the I2S LRCK coming from the microcontroller. It can be seen that the input starts to ramp down linearly and then ramps up logarithmically immediately after the I2S clock halts. The BCK clock is also halted at the same time.



All configuration pins are pulled to zero (directly connected to ground). Please see below for the schematic:

We are using 2 channels as single-ended audio source. They are connected exactly as in the datasheet with the additional anti aliasing filter, with the addition of one 100k resistor to ground, which I think might be redundant:

For reference, this is the input schematic from the PCM186x datasheet:

The dip is also observed if nothing is connected to the audio input. Therefore, the dip/glitch must be caused by the PCM1861.
What is causing the input to dip? And is there something we can do about it? We don't have full control over the I2S clock signal so we are not able to ensure it will also keep on running.
Thank you in advance for your help.