TDA4VH-Q1: Up to date onnxruntime version?

Tassilo Glander

Part Number: AM69A
Other Parts Discussed in Thread: AM69

Hi,

we are investigating the use of TI AM69A and AM62A processors.

One issue is the support for onnxruntime. In your documentation for the AN62A board you mention you support the more recent 1.20.1 (as of March 2026 the latest version is 1.24.4) https://software-dl.ti.com/processor-sdk-linux-rt/esd/AM62X/latest/exports/docs/linux/Foundational_Components/Machine_Learning/onnxrt.html

But on the installed board you support 3 year old version 1.15.0 https://github.com/TexasInstruments/edgeai-tidl-tools/blob/11_02_04_00/README.md#version-compatibility

I also see you forked onnxruntime and your TIDL execution provider has not been upstreamed to the vanilla onnx runtime repository.

For us, this is a limitation because

- not always all the new functionality of more recent ONNX opsets are supported, so the question is how future proof are these boards

- patches against vulnerabilities will not be up to date, which is a problem with regulations that require us to report CVEs and, in worst case, stop shipping products until solved

Could you clarify on the versions that you support? What is your roadmap for updating or even upstreaming your onnxruntime changes and maybe becoming an official supporter?

Thanks

Tassilo

3 months ago

0 Mukul Bhatnagar 3 months ago

TI__Guru* 85895 points

Hello Tassilo

Please note the following E2E FAQ on AM69/A

(44) [FAQ] Important Notice for Support transition for AM68/AM68A and AM69/AM69A devices - Processors forum - Processors - TI E2E support forums

We no longer support AM69 family of devices on public E2E and recommend customers to evaluate Toradex offering for their hardware/software needs.

I will assign this thread in context of your AM62A query. The assigned expert is out today, so please expect some delays in response.

Regards

Mukul

0 Tassilo Glander 3 months ago

Prodigy 10 points

Thanks Mukul,

Then maybe TDA4 is the better product term here - do you support this? Generally I am interested in the software support of TIDL with respect to the onnx runtime.

Best, Tassilo

0 Mukul Bhatnagar 3 months ago in reply to Tassilo Glander

TI__Guru* 85895 points

Tassilo

Ok, let me reassign this to the product team supporting TDA4. I also want our team to comment on your AM62A query, but the assigned expert is out till tomorrow.

Will monitor this thread to ensure someone is getting back to you in next couple of days.

Regards

Mukul

0 Brijesh Jadav 3 months ago

TI__Guru**** 498805 points

Hi Tassilo,

We have some plans to update ONNX and OpSet, any specific version/feature that you are looking for? I can take it to team and update about it.

Regards,

Brijesh

0 Tassilo Glander 3 months ago in reply to Brijesh Jadav

Prodigy 10 points

Hi Brijesh,

in general, we are not looking for a specific version or feature, but for a broader statement on your long term support of this platform. We want to offer to our customers a long term solution, both in terms of AI features as well as legal safety from the obligations to fix vulnerabilities in products.

My two questions

1. What is your plan with regards to updating and keeping the onnx runtime library up to date?

2. There is a discrepancy between the versions of onnx runtime in your docs (see above). Can you clarify?

Thanks,

Tassilo

0 Brijesh Jadav 3 months ago in reply to Tassilo Glander

TI__Guru**** 498805 points

Hi Tassilo,

We have plans to migrate to ORT 1.23 version in one of the upcoming TIDL release. The exact SDKr where this will be added is not yet available.

I think the above link on AM62A looks like for ARM only parts.. Mukul Bhatnagar , can you please confirm it?

Regards,

Brijesh

+1 Reese Grimsley 3 months ago in reply to Brijesh Jadav

TI__Mastermind 19196 points

Tassilo Glander said:
2. There is a discrepancy between the versions of onnx runtime in your docs (see above). Can you clarify?

There is a difference in these ONNXruntime versions for accelerated devices with C7 NPU (AM6xA e.g. AM62A, and TDA4x) devices and arm-only devices like AM62x, AM64, etc.

For arm-only devices, we are updating this version at major SDK version upgrade (for 12.x, plan is to support 1.23.2; in current 11.x SDKs, it is 1.20.1). This uses the upstream version

For C7x NPU devices, this lags behind and uses our onnxruntime fork, which you've found. This versioning is linked to our own model import / compilation tooling, and upgrades at a different pace since ONNXRT must interface with our own model import, optimization, and quantization tooling for TIDL. This does mean the supported opset may not be the latest version. Per Brijesh's comment, our next planned version upgrade would be ONNXRuntime 1.23

Brijesh Jadav said:
Mukul Bhatnagar , can you please confirm it?

This was for an Arm-only part. It is for AM62(x), not AM62A

BR,
Reese

0 Tassilo Glander 3 months ago in reply to Reese Grimsley

Prodigy 10 points

Thanks Brijesh and Reese!

The plans to upgrade to 1.23 sound promising, this is much closer to the latest in terms of features and patch level.

Also I understand now the source of my confusion regarding AM62X vs AM62A.

Best,

Tassilo