J784S4XEVM: SDK11.2: Error while implementing TIDL Custom Op

Hello,

Any updates please?

FYI: I tried the same logic with a custom Op using 1 input and 1 output (Ceil) and it's working so I think the problem is with the operators which has more then 1 input.

Hello Ghassen,

ok, i am also seeing the same error on the SDK11.02 release. but looking at the graph, it seems you are using equal operator, which is boolean. This is not yet supported in the current TIDL implementation. 

Regards,

Brijesh

Hello Brijesh,

Thank you for your reply.

About the previous thread you mentioned before we were talking about sdk10 and how to use the 2nd pointer on the inputs during the custom op execution. 

Here we are using SDK11.2 and we cannot even compile the model. 

For the boolean support, using these lines in TIDL_ortGetType function (treat bool as uint8) it will pass (it was working with sdk10)

I tried with another custom op Tile but I have this error during the compilation:

You can find here the model and the custom folder: tile_model.zip 4064.custom.zip

Hello Ghassen,

Is the custom implementation correct? It looks like TIDL is not able to identify model type, and it gives error "Unsupported model type". It looks like you have removed ONNX from one of the condition in tidl_custom_import.c file. Is this required change? 

If i just revert this change, i see segmentation fault error. Do you also see similar error? 

Regarding Equal layer, when i used this layer, i was getting below error while compilation, but once i converted output to float, then it started compiling. i checked with the TIDL team and confirmed that boolean output is not yet supported SDK.

[TIDL Import]  ERROR:  - Failed in function: tidl_optimizeNet -- [tidl_import_core.cpp, 3092]
[TIDL Import]  ERROR: Network Optimization failed - Failed in function: TIDL_runtimesOptimizeNet -- [tidl_runtimes_import_common.cpp, 1544]
[TIDL Import] [PARSER] ERROR:  - Failed in function: TIDL_computeImportFunc -- [tidl_onnxRtImport_EP.cpp, 2715]

Regards,

Brijesh

Hello Brijesh,

Thank you for your reply.

For Equal operator, I tried to convert the output to uint8 and float but still I have the same error. Can you tell me how made it?

And for Tile operator, do you have any suggestion for the error because it was working with sdk10.1?

Regards,

Ghassen

Hello Ghassen,

It seems this thread is not related this question. Anyway, i just use online tools to add cast operator. 

Sorry what is question on the tile operator? which error do you mean? 

Regards,

Brijesh

Hello Brijesh,

During the compilation of a standalone Tile model, I have this error,

Regards,

Ghassen

Hello Ghassen,

Are you using multiple inputs in the custom layer? Because this error comes when using multiple inputs.

Regards,

Brijesh

Hello Brijesh,

That is correct. The issue is related to custom operators with multiple inputs.

Regards,

Ghassen

Hello Ghasem,

But as per our last communication, multiple inputs for custom layer is not yet supported, isn't it?

Regards,

Brijesh

Hello Brijesh,

We noticed that your previous reply mentioned that this operation is not supported, but it was later updated and changed to a suggestion instead.

Because of this change, we thought there might have been a misunderstanding.

Regards,

Ghassen

Hello Ghassen,

Ghassen souissi said:

but it was later updated and changed to a suggestion instead.

Sorry, i did not know about this. As far as i understand, it is still not supported. You might be enabled with some custom changes.. Will check it internally. 

Regards,

Brijesh

Hello Brijesh

Thank you for your reply.

I wanted to follow up and ask if there are any updates regarding this issue.

Regards,

Ghassen

Hello Ghassen,

There is a small change required in one of the binary. Not sure how to share this with ELCO. Do you have cdds access? 

Regards,

Brijesh

Hello Brijesh,

We currently do not have cdds access. Could you please provide us access and share the binary there?

Regards,

ghassen

Hello Gassem,

Can you please ask this to local TI FAE or support team to provide access to cdds?

Regards,

Brijesh