TAS2505: intermittent ability to play digital audio after power up

After confirming that the power up timings are within the limits of the TAS2505 Application Reference Guide (pg 45) we ran out of options to explain why the TAS2505 fails to play audio at about 50% of the time after power up. Few interesting facts that eliminate the behavior, but don't necessarily solve the issue:

1. The problem only occurs with a 4-Ohm speaker. When using a 8-Ohm speaker the behavior does not occur
2. Besides using a 4-Ohm speaker, the conditions that the problem manifests itself is when the volume is high:
   1. The volume settings used for low volume are 10dB (Digital Volume), -10dB (Intermediate gain stage), 6dB (output gain stage) – never see issues at this volume.
   2. The volume settings used for high volume are 12.5dB (Digital Volume), 0dB (Intermediate gain stage), 18dB (output gain stage)– see issues at this volume but it is intermittent.
3. By mistake, the customer set bits 6 and 7 of page 1, byte 0x02, which are reserved, and the issue disappeared. They were trying to set the LDO voltage (bits 4 & 5). 
4. Colder temperatures (below 10°C) make the problem more frequent. 

The above circumstances make me wonder whether the output power is causing the device to trip somehow. Can you provide some guidance on how to debug this issue? Thank you!