TDA2EXEVM: TIDL OD use+case generate wrong result with user model

Eric Lai

Expert 1140 points

Part Number: TDA2EXEVM

Hi TIDL experts,

Thank you for your great support until now.

I have a SSD-based model and i try to put it on the OD use-case.

And it create unexpected result, a lot of random small boxes on the screen.

I check the import layer level and also the tidl tb results , and all of them are the similar with caffe and proper.

So it seems that the mismatch result is generated by the OD-usecase .

Is there any suggestion or possible solution about this?

The original question is this thread:

e2e.ti.com/support/processors/f/791/t/729679#pi239031349=2

Thank you.

Best Regards,

Eric Lai

over 6 years ago

0 Praveen Eppa1 over 6 years ago

TI__Genius 17580 points

Hi Eric Lai,

There is a new vision SDK release version 03.05.00.00 available now, can you please check with this new release and report here.

Thanks,
Praveen

0 Eric Lai over 6 years ago in reply to Praveen Eppa1

Expert 1140 points

Hi Praveen,

Okay, I will give it a try.
Thank you so much.

Best Regards,
Eric Lai

0 Eric Lai over 6 years ago in reply to Praveen Eppa1

Expert 1140 points

Hi Praveen,

I tried the new version SDK.
And like the previous version, the result is matching between caffe , import ,and also tidl testbench.
On the use-case, finally the result is proper , the unexpected small box are gone.
Thank you.

But there is still some different between the video from caffe and use-case.
Especially for the small object, the confidence is lower.
I set the quanthistory to zero, the result is the same.
Is there any possible reason about this?

Best Regards,
Eric Lai

0 Praveen Eppa1 over 6 years ago in reply to Eric Lai

TI__Genius 17580 points

Hi Eric Lai,

Can you experiment with below quant history parameters and check.
createParams.quantHistoryParam1 = 5; // increase in steps of +5
createParams.quantHistoryParam2 = 5; // increase in steps of +5
createParams.quantMargin = 0; // increase in steps of +5

Thanks,
Praveen

0 Eric Lai over 6 years ago in reply to Praveen Eppa1

Expert 1140 points

Hi Praveen,

I tried the parameters but the results are similar.
It seems that it's not the reason of this issue?
Any suggestion about this?

Best Regards,
Eric Lai

0 Eric Lai over 6 years ago in reply to Praveen Eppa1

Expert 1140 points

Hi Praveen,

Any update?
On the use-case, the result is different.
Btw, the number of layers of my model is almost 120.
Maybe this is the reason why it cause this issue?

Best Regards,
Eric Lai

0 Praveen Eppa1 over 6 years ago in reply to Eric Lai

TI__Genius 17580 points

Hi Eric Lai,

How big is the difference in behaviour on the use-case verses tidl test bench.
Can you please share some screen shots of the output so that I will get it reviewed with VSDK expert for quick look and suggestions.

Thanks,
Praveen

0 Eric Lai over 6 years ago in reply to Praveen Eppa1

Expert 1140 points

Hi Praveen,

Caffe , import and TIDL testbench are matching.

And here is the video result on caffe and OD use-case.

The confidence of the some object are lower .

You can see some boxes are blinking .

I have no idea about this issue.

Thank you.

Best Regards,

Eric Lai

TDA2_result.rar

caffe_result.rar

0 Praveen Eppa1 over 6 years ago in reply to Eric Lai

TI__Genius 17580 points

Hi Eric Lai,

Can you decrease the confidence threshold and check?

Thanks,
Praveen

0 Eric Lai over 6 years ago in reply to Praveen Eppa1

Expert 1140 points

Hi Praveen,

The original threshold of caffe and usecase are the same. ( =0.3)
And I follow your instruction to decrease the threshold. ( =0.1)
And the result seems better but still not proper.
The boxes are still blinking not like the original caffe.

Best Regards,
Eric Lai

Processors

Processors forum

TDA2EXEVM: TIDL OD use+case generate wrong result with user model