DAC60504: VREF internal disabling before the external reference

Hello,
In our application, we use severals DAC60504 with external reference. If the external refernce is suppled before the disabling of the internal reference (via the register 3, bit REF-PWDWN), there is risk to damage the component ? Because of the functional diagram, the switch for the internal refrence is enabled by default :

Thank you.
Best regards,
Vincent.