When we run the python example for our custom model on PC to generate the model artifacts using edgeai-tidl-tools,and the model artifacts is generated successfully,but when we run the osrt_cpp ort example for our model using edgeai-tidl-tools,the programm will be stuck in session.Run. Log is as below:
[21:33:10.000.000000]:INFO:[main:0628] jiang: 33
[21:33:10.000.000090]:INFO:[main:0634] jiang: 44
***** Display run Config: start *****
verbose level set to: 3
accelerated mode set to: 1
device mem set to: 1
loop count set to: 1
model path set to:
model artifacts path set to: model-artifacts/PSD_2branch_sigmoid_0704/
image path set to: test_data/bird_384_16m.jpg
device_type set to: cpu
labels path set to: test_data/labels.txt
num of threads set to: 4
num of results set to: 5
num of warmup runs set to: 2
***** Display run Config: end *****
[21:33:10.000.000397]:INFO:[main:0636] jiang: 55
[21:33:10.000.000424]:INFO:[main:0638] jiang: 66
[21:33:10.000.000453]:INFO:[main:0641] jiang: 77
[21:33:10.006.006237]:INFO:[main:0647] jiang: 88
[21:33:10.006.006275]:INFO:[runInference:0293] jiang: 1
[21:33:10.006.006288]:INFO:[runInference:0300] jiang: 2
[21:33:10.063.063689]:INFO:[runInference:0304] jiang: 3
[21:33:10.063.063760]:INFO:[runInference:0308] jiang: 4
[21:33:10.063.063779]:INFO:[runInference:0311] accelerated mode
[21:33:10.063.063807]:INFO:[runInference:0314] artifacts: model-artifacts/PSD_2branch_sigmoid_0704/
[21:33:10.063.063853]:INFO:[runInference:0334] jiang: 7
libtidl_onnxrt_EP loaded 0x4600b40
Final number of subgraphs created are : 1, - Offloaded Nodes - 138, Total Nodes - 138
APP: Init ... !!!
MEM: Init ... !!!
MEM: Initialized DMA HEAP (fd=4) !!!
MEM: Init ... Done !!!
IPC: Init ... !!!
IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
1862.582989 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
1862.588896 s: VX_ZONE_INIT:Enabled
1862.588916 s: VX_ZONE_ERROR:Enabled
1862.588924 s: VX_ZONE_WARNING:Enabled
1862.591292 s: VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
1862.593227 s: VX_ZONE_INIT:[tivxHostInitLocal:86] Initialization Done for HOST !!!
[21:33:11.591.591934]:INFO:[runInference:0338] Loaded model model-artifacts/PSD_2branch_sigmoid_0704//../../models/public/PSD_2branch_sigmoid_0704.onnx
[21:33:11.592.592006]:INFO:[runInference:0365] aaa 0
[21:33:11.592.592029]:INFO:[runInference:0379] aaa 1
[21:33:11.592.592046]:INFO:[runInference:0386] aaa 2
[21:33:11.592.592064]:INFO:[printTensorInfo:0216] number of inputs:1
[21:33:11.592.592078]:INFO:[printTensorInfo:0217] number of outputs: 2
[21:33:11.592.592090]:INFO:[printTensorInfo:0218] input(0) name: images
[21:33:11.592.592103]:INFO:[printTensorInfo:0223] Input 0 : name=images
[21:33:11.592.592118]:INFO:[printTensorInfo:0230] Input 0 : type=1
[21:33:11.592.592132]:INFO:[printTensorInfo:0233] Input 0 : num_dims=4
[21:33:11.592.592146]:INFO:[printTensorInfo:0236] Input 0 : dim 0=1
[21:33:11.592.592158]:INFO:[printTensorInfo:0236] Input 0 : dim 1=3
[21:33:11.592.592171]:INFO:[printTensorInfo:0236] Input 0 : dim 2=224
[21:33:11.592.592183]:INFO:[printTensorInfo:0236] Input 0 : dim 3=224
[21:33:11.633.633197]:INFO:[preprocImage:0127] template NCHW
[21:33:11.633.633435]:INFO:[runInference:0401] ONNX_TENSOR_ELEMENT_DATA_TYPE_FLOAT 3
[21:33:11.633.633462]:INFO:[runInference:0416] CreateCpu 3
[21:33:11.633.633484]:INFO:[runInference:0419] CreateTensor 3
[21:33:11.633.633498]:INFO:[runInference:0423] SetRunLogVerbosityLevel 3
The programm will be stuck in the following code: