Tool/software:
hello,
we found the model output is different between X86 simulation and product board. we share the model and input. we use tidl 0902 to quantize and convert model. I hope ti can help us to fix this problem.shareti.zip
This thread has been locked.
If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.
Tool/software:
hello,
we found the model output is different between X86 simulation and product board. we share the model and input. we use tidl 0902 to quantize and convert model. I hope ti can help us to fix this problem.shareti.zip
Hi Zhenzhou,
You can try different quantization options: https://github.com/TexasInstruments/edgeai-tidl-tools/blob/master/docs/tidl_fsg_quantization.md#b2-advanced-calibration It has different effect on different models.
You can also try setting certain layers to 16bit if you can found oud which layer causes the major loss.
If all these steps does not solve your problem. Please try QAT: https://github.com/TexasInstruments/edgeai-tensorlab/blob/3de61dfa503c408346c3bcd029f49a25e42a8a73/edgeai-modeloptimization/torchmodelopt/edgeai_torchmodelopt/xmodelopt/quantization/README.md#option-2-quantization-aware-training-qat--post-training-calibration-ptc-using-this-repository
Regards,
Adam
but how can we fix this in version 9.2, can you share us a patch
Hi
As for this issue, we have a patch now but please wait me to verify this.
Regards,
Adam
Hello zhenzhou
I compared layer traces on pc an evm on sdk 11.0. I don't see mismatch:
Can you try this as well on your side?
Regards,
Adam