Part Number: AMC0330R
In 7.3.3 Vout formula is listed as:

But there is also a figure that says Vout = 0.9*VREF when VIN=VFSR, these 2 information doesn't add up.

Take VREF=3V; VIN=1V as example, with the formula we got Vout = 1/1.28*1.5+1.5 = 2.67V, with the figure we got Vout = 0.9*3 = 2.7V
Either the formula didn't take non-linearity into account or the figure is wrong. The formula of this figure in linear zone is in fact:
VOUT = VIN/VFSR*(90%-10%)*VREFIN/2+VREFIN/2