TDA4VM: TDA4VM: Not able to infer high resolution images on target

Adarsh Kumar

Part Number: TDA4VM

Tool/software:

Dear Team,

I am trying to infer image of size (512 x 1024) on the target, but it is giving me below error.

Although, the same network I am able to infer at (320 x 512) resolution on target.
Also, when I am removing below layers, then I am able to infer on target at (512 x 1024) resolution:

'''

1. self.avg_layer = nn.AvgPool2d(kernel_size=3, stride=1, padding=1)
2. def channel_shuffle(x, groups):

b, c, h, w = x.shape

x = x.reshape(b, groups, -1, h, w)

x = x.permute(0, 2, 1, 3, 4)

x = x.reshape(b, -1, h, w)

return x

'''

Is there something which I can change during importing the ONNX?

Thanks and Regards,

Adarsh Kumar

4 months ago

0 Wen Li 4 months ago

TI__Expert 7161 points

Hi;

Thanks for the question.

But I am not sure what your model look like by just reading the posting.

In general, Here is the process for you to use ONNX to convert/import the model.

https://github.com/TexasInstruments/edgeai-tidl-tools/blob/master/docs/custom_model_evaluation.md#custom-model-evaluation

You can click "ONNX Runtime Python API" on the page to find out more information.

Best regards

Wen Li

0 Adarsh Kumar 4 months ago in reply to Wen Li

Prodigy 30 points

Dear Mr Li,

Thank you for the response.

Additional Details:
1. TI SDK: 8.02
2. I am using below link for PC emulation and target inference:
https://software-dl.ti.com/jacinto7/esd/processor-sdk-rtos-jacinto7/08_02_00_05/exports/docs/tidl_j721e_08_02_00_11/ti_dl/docs/user_guide_html/md_tidl_sample_test.html

Wen Li said:
But I am not sure what your model look like by just reading the posting.

Below is the attention module that I am using in my model:

Note:

1. The model is able to inference on TDA4VM target without this module at (512x1024) resolution.
2. The model is able to inference in PC emulation with this module at (512x1024) resolution.
3. The model is able to inference on TDA4VM target with this module at (320x512) resolution.

Kindly have a look again and let me know anything can be tried to resolve this issue.

Thanks and Regards,
Adarsh Kumar

Processors

Processors forum

TDA4VM: TDA4VM: Not able to infer high resolution images on target