Could you explain where the broad tolerance comes from, does IC itself have the variation?
I see the setting values of the sensitivity of TMS37127 as the attached here. Each value relatively has a wide range.
For example, we compare the setting of the sensitivity, DEC15 (high 0xF) and DEC0 (low, 0x0)
We may understand that he max. sensitivity of DEC15, 10mVpp is the same level of the min. sensitivity of DEC0, 9.5mVPP.
Best regards,
N.A.