J722SXH01EVM: Segmentation model automatic mixed precision fails on both 11.02.15 and 11.02.16

Lu Yanling

Hi TI TIDL support team,

We are using edgeai-tidl-tools for model quantization/compilation on J722S.

For our segmentation model, automatic mixed precision fails on both 11.02.15 and 11.02.16. The detailed version information, run commands, and failure logs are included in the attached log files.

Previously, TI suggested using manual 16-bit layer selection as a workaround. However, the accuracy from manually selected mixed precision layers still does not meet our requirement.

Therefore, we now need automatic mixed precision to work correctly, and would like your help to identify and resolve the root cause of this failure.

seg.rar

12 days ago

0 Vaibhav Kumar 12 days ago

TI__Intellectual 2100 points

Hi,

I have created JIRA (https://jira.itg.ti.com/browse/TIDL-14873?src=confmacro) for this issue. I will update here as we find the root cause.

0 Vaibhav Kumar 10 days ago in reply to Vaibhav Kumar

TI__Intellectual 2100 points

Hi Lu Yanling,
https://e2e.ti.com/cfs-file/__key/communityserver-discussions-components-files/791/tidl_5F00_import_5F00_changes.patch

You can apply these two changes on sdk, and generate new tools using

./sdk_builder/scripts/setup_psdk_rtos.sh --install_tidl_deps
cd sdk_builder
make tidl_pc_tools -j

Tools will be available at ./c7x-mma-tidl/tidl_tools and ./tidl_tools.tar.gz

I am also attaching new tools (11.02.16.00) with the changes 2045.tidl_tools.tar.gz

0 Yong Zhang 4 days ago in reply to Vaibhav Kumar

TI__Mastermind 20011 points

Dear Yanling.

May I ask if you have verified the patch? Would you please help share the progress on your side?

Vaibhav Kumar said:
tidl_import_changes.patch

thanks a lot!

yong

0 Lu Yanling 4 days ago in reply to Yong Zhang

Prodigy 20 points

Hi yong,

It has been confirmed that patch can solve the problem of mixed quantization failure in the model, but it has not completely solved the problem of poor model accuracy. The specific details have been replied to Vaibhav Kumar.

0 Vaibhav Kumar 3 days ago in reply to Yong Zhang

TI__Intellectual 2100 points

Hi, can we close this particular e2e since the compilation issue in AMP has been addressed. We would like to maintain topic separability.
Thanks
Vaibhav

Processors

Processors forum

J722SXH01EVM: Segmentation model automatic mixed precision fails on both 11.02.15 and 11.02.16