PROCESSOR-SDK-DRA8X: Can we use MMA library directly without going through TIDL?

Sainath R1

Intellectual 585 points

Part Number: PROCESSOR-SDK-DRA8X

Hi,

I found a question in this forum (the link is below) regarding using of MMA library API's directly.

https://e2e.ti.com/support/processors/f/791/t/851565

Can you please suggest which one to follow.

Thank you in advance.

Best Regards,

over 6 years ago

0 Shyam Jagannathan over 6 years ago

TI__Genius 10365 points

Hi Sainath,

Apologize for a late reply, yes you can use MMALIB API's directly but you will have figure out the optimal data movement path for the kernels. TIDL achieves this with some smart memory management techniques which improves the overall performance.

The e2e link you are looking at is the way to go, for additional information please look at MMALIB documentation,

psdk_rtos_auto_j7_06_02_00_21/mmalib_01_01_00_00/docs/user_guide/modules.html

Regards,
Shyam

0 Henry2333 over 6 years ago in reply to Shyam Jagannathan

Intellectual 500 points

Hi Shyam

Can you tell me how TIDL manages memory? Is UDMA used to move data from DDR to L2?

I want to use the mma library in c7x to get better performance. Do you have any suggestions for memory management?

Regards,

Henry

0 Shyam Jagannathan over 6 years ago in reply to Henry2333

TI__Genius 10365 points

TIDL uses DRU and UDMA to make efficient data transfers. Ill let an expert comment this.

Regards,

Shyam

0 Anshu Jain over 6 years ago in reply to Henry2333

TI__Guru 56820 points

Hi Henry,

It is not very recommended to use MMALIB directly as MMALIB implementation have lot of understanding of how data movements are happening with TIDL. Can you explain more on what performance benefits you are talking about here? What are you comparing it against?

Regards,

Anshu

0 user5957510 over 6 years ago in reply to Anshu Jain

Intellectual 260 points

I would like to ask, is there any detailed documentation for TIDL's memory management?Is the source code for TIDL open to the public?

0 Henry2333 over 6 years ago in reply to Anshu Jain

Intellectual 500 points

Hi Anshu,

Thank you for the reply.

I found that in some cases, using the matrix transposition module in mma is faster than the method implemented by the c7x instruction.

So I was wondering if I could use other mma modules (such as matrix multiplication) to speed up my algorithm to achieve good performance like TIDL.

Regards,

Henry

0 Anshu Jain over 6 years ago in reply to Henry2333

TI__Guru 56820 points

Hi Henry,

Are you saying you want to use MMALIB for non-deep learning related processing?

Regards,
Anshu

0 Sainath R1 over 6 years ago in reply to Anshu Jain

Intellectual 585 points

Hi Anshu,

Is It possible to compile and use MMALIB on bare-metal (no TI-RTOS)? on C7x core?

I also posted this question in another thread actually: https://e2e.ti.com/support/processors/f/791/t/910926

Thank you in advance.

Regards,

Sainath

0 Henry2333 over 6 years ago in reply to Anshu Jain

Intellectual 500 points

Hi, AnShu

Yes.

And I want to run my algorithm on c7x without TIDL.

The reason I want to use MMA is that MMA has better performance than the c7x instruction set.

So can you give me some suggestions on how to optimize on the c7x platform?

Especially some memory management suggestions.

Maybe not using MMA, I just want to get better performance.

Thanks for your advice.

Regards,

Henry

0 Anshu Jain over 6 years ago in reply to Henry2333

TI__Guru 56820 points

Hi Henry.

Regarding the following point :

"I want to run my algorithm on c7x without TIDL" .

Is your application a non-deep learning application?

Regards,

Anshu

0 Henry2333 over 6 years ago in reply to Anshu Jain

Intellectual 500 points

Hi Anshu.

Yes.It is a non-deep learning application.

Regards,

Henry

Processors

Processors forum

PROCESSOR-SDK-DRA8X: Can we use MMA library directly without going through TIDL?