DRA756: Can I do Semantic Segmentation on this platform?

user4682253

Part Number: DRA756

Hi there,

I went across the TI demo for semantic segmentation on CES 2017 earlier this year. Although the demo was carried out on TDA2x the video was very impressive. I'd like to know whether it is possible to get it done on J6 as the specs of the two platforms are quite similar.

If that's possible, can anyone point out the right instructions that I should follow. I have seen some previous posts on TIDL where caffe-jacinto was introduced (about sparse and quantified models). I am more interested in examples showing the inference of a neural net. Maybe I missed some info in that post. It would be very nice if someone could give me some suggestions regarding this topic.

Many thanks in advance.

Kind regards,

Matt

over 7 years ago

0 user4682253 over 7 years ago

Prodigy 70 points

Hi there,

After some homework I found some useful documents from vision SDK 3.0... However, the datasheet says it would take more than 300 ms for the EVES to do the segmentation (it was a real time application demo shown in CES 2017).

I wonder if the time consumption shown in the datasheet (300 ms) is almost the limit of the platform(for use EVEs only) or it could be reduced by using smaller Neural Nets.

Suggestions would be appreciated.

Regards,
Matt

0 Yordan Kamenov over 7 years ago in reply to user4682253

TI__Mastermind 42515 points

Hi Matt,

I have forwarded your question to algorithms experts.

Regards,
Yordan

0 Sam Yu1 over 7 years ago in reply to Yordan Kamenov

TI__Prodigy 120 points

Hi, Yordan,

Has any expert answered this question?

Thanks!

0 Mariya Petkova over 7 years ago in reply to Sam Yu1

TI__Expert 4885 points

Hi, Sam Yu1 ,

There is still not answer. I pinged the expert.

Regards,
Mariya

0 Pramod Kumar Swami over 7 years ago in reply to Sam Yu1

TI__Genius 14000 points

Hi Matt,
It was run on the part with 4xEVE @ 900 MHz and the frame rate was 20 fps. The same number you see in TIDL data sheet - 165 mega cycles/EVE.
So the demo should run on the parts with 4xEVE @ 900 MHz.
I think DRA756 has 2xEVE so you would be able to tun on half the speed.

Thanks,
with Regards,
Pramod

0 user4682253 over 7 years ago in reply to Pramod Kumar Swami

Prodigy 70 points

Hi Pramod,

How did you get the 2 EVEs run in parallel? Did you cut the input image into 2 pieces or use other tricks?

If you cut the image, then how did you deal with the potential disagreement of output at the intersection part.

Regards,
Matt

0 user4682253 over 7 years ago in reply to Pramod Kumar Swami

Prodigy 70 points

Also, is there any .mat to .bin convert file that I can use to implement the ACF-based classifier (trained using jacinto-ACF on github)?

Many thanks in advance.

Matt

0 Pramod Kumar Swami over 7 years ago in reply to user4682253

TI__Genius 14000 points

HI Matt,

In current configuration, entire frame was offloaded to each EVE to keep things simple, though it creates more delay.

Thanks,

with Regards,

Pramod

0 Pramod Kumar Swami over 7 years ago in reply to user4682253

TI__Genius 14000 points

Yes -there is a tool, let me see if it is part of release, if not how can it be relased.

0 user4682253 over 7 years ago in reply to Pramod Kumar Swami

Prodigy 70 points

It would be very nice if you could release the tool. Sam Yu1 might be able to help with this.

Thanks,

Matt

0 user4682253 over 7 years ago in reply to Pramod Kumar Swami

Prodigy 70 points

Hi Pramod,

Can you please give me a bit more hints on this?

From my understanding, the entire frame was loaded to each EVE, but different ROIs was set for each EVE. Or there is some other parallel processing scheme that make both EVEs process the same region of image in parallel?

Regards,
Matt

0 Pramod Kumar Swami over 7 years ago in reply to user4682253

TI__Genius 14000 points

This question is answered in below thread.
e2e.ti.com/.../625320

Thanks,
With Regards,
Pramod

0 Sam Yu1 over 7 years ago in reply to Pramod Kumar Swami

TI__Prodigy 120 points

Hi, Kumar,

Could you please release this tool to sam-yu@ti.com？ We have signed NDA with them. Thanks!

Processors

Processors forum

DRA756: Can I do Semantic Segmentation on this platform?