Hello,
I am trying to port yoloV4 network to the Ti board. I needed to replace the unsupported layers with the supported ones from Ti to convert the weights to onnx format.
After that I was able to use the TiDL importer tool to generate the bin files (tidl_net.bin and tidl_io.bin)
I modified the TiDL application to read my input tensor but running the code gives a segmentation fault error at a specific layer (BottleneckCSP2). This layer is repeated 3 times but the code only fails in the second time where the layer size increases significantly.
I don't understand why it works fine when I use the TiDL converter but not with the application. Should I increase the memory size in the application graph? if yes how can I do that?
The allocated memory size for each record by TiDL importer..
The allocated memory for each record by the application...
\
As you can notice, the allocated memory size for each node is different.
Another points, while processing each layer by the TiDL importer, the shown output has the same layer ID of the processed layer as following:
But while running the application, the shown output isn't always related to the processed layer.
Here you can find out the network details.
tidl_net.txt
Num of Layer Detected : 120
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Num|TIDL Layer Name |Out Data Name |Group |#Ins |#Outs |Inbuf Ids |Outbuf Id |In NCHW |Out NCHW |MACS |
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
0|TIDL_DataLayer |input.1_original | 0| -1| 1| x x x x x x x x | 0 | 0 0 0 0 | 1 3 1152 1152 | 0 |
1|TIDL_ConvolutionLayer |447 | 0| 1| 1| 0 x x x x x x x | 1 | 1 3 1152 1152 | 1 16 1152 1152 | 594542592 |
2|TIDL_ConvolutionLayer |450 | 0| 1| 1| 1 x x x x x x x | 2 | 1 16 1152 1152 | 1 32 576 576 |1539440640 |
3|TIDL_ConvolutionLayer |453 | 0| 1| 1| 2 x x x x x x x | 3 | 1 32 576 576 | 1 16 576 576 | 175177728 |
4|TIDL_ConvolutionLayer |456 | 0| 1| 1| 3 x x x x x x x | 4 | 1 16 576 576 | 1 32 576 576 |1539440640 |
5|TIDL_EltWiseLayer |457 | 0| 2| 1| 2 4 x x x x x x | 5 | 1 32 576 576 | 1 32 576 576 | 10616832 |
6|TIDL_ConvolutionLayer |460 | 0| 1| 1| 5 x x x x x x x | 6 | 1 32 576 576 | 1 64 288 288 |1534132224 |
7|TIDL_ConvolutionLayer |463 | 0| 1| 1| 6 x x x x x x x | 7 | 1 64 288 288 | 1 32 288 288 | 172523520 |
8|TIDL_ConvolutionLayer |472 | 0| 1| 1| 6 x x x x x x x | 8 | 1 64 288 288 | 1 32 288 288 | 169869312 |
9|TIDL_ConvolutionLayer |466 | 0| 1| 1| 7 x x x x x x x | 9 | 1 32 288 288 | 1 32 288 288 | 87588864 |
10|TIDL_ConvolutionLayer |469 | 0| 1| 1| 9 x x x x x x x | 10 | 1 32 288 288 | 1 32 288 288 | 767066112 |
11|TIDL_EltWiseLayer |470 | 0| 2| 1| 7 10 x x x x x x | 11 | 1 32 288 288 | 1 32 288 288 | 2654208 |
12|TIDL_ConvolutionLayer |471 | 0| 1| 1| 11 x x x x x x x | 12 | 1 32 288 288 | 1 32 288 288 | 84934656 |
13|TIDL_ConcatLayer |473 | 0| 2| 1| 12 8 x x x x x x | 13 | 1 32 288 288 | 1 64 288 288 | 5308416 |
14|TIDL_BatchNormLayer |475 | 0| 1| 1| 13 x x x x x x x | 14 | 1 64 288 288 | 1 64 288 288 | 10616832 |
15|TIDL_ConvolutionLayer |478 | 0| 1| 1| 14 x x x x x x x | 15 | 1 64 288 288 | 1 64 288 288 | 345047040 |
16|TIDL_ConvolutionLayer |481 | 0| 1| 1| 15 x x x x x x x | 16 | 1 64 288 288 | 1 128 144 144 |1531478016 |
17|TIDL_ConvolutionLayer |484 | 0| 1| 1| 16 x x x x x x x | 17 | 1 128 144 144 | 1 64 144 144 | 171196416 |
18|TIDL_ConvolutionLayer |507 | 0| 1| 1| 16 x x x x x x x | 18 | 1 128 144 144 | 1 64 144 144 | 169869312 |
19|TIDL_ConvolutionLayer |487 | 0| 1| 1| 17 x x x x x x x | 19 | 1 64 144 144 | 1 64 144 144 | 86261760 |
20|TIDL_ConvolutionLayer |490 | 0| 1| 1| 19 x x x x x x x | 20 | 1 64 144 144 | 1 64 144 144 | 765739008 |
21|TIDL_EltWiseLayer |491 | 0| 2| 1| 17 20 x x x x x x | 21 | 1 64 144 144 | 1 64 144 144 | 1327104 |
22|TIDL_ConvolutionLayer |494 | 0| 1| 1| 21 x x x x x x x | 22 | 1 64 144 144 | 1 64 144 144 | 86261760 |
23|TIDL_ConvolutionLayer |497 | 0| 1| 1| 22 x x x x x x x | 23 | 1 64 144 144 | 1 64 144 144 | 765739008 |
24|TIDL_EltWiseLayer |498 | 0| 2| 1| 21 23 x x x x x x | 24 | 1 64 144 144 | 1 64 144 144 | 1327104 |
25|TIDL_ConvolutionLayer |501 | 0| 1| 1| 24 x x x x x x x | 25 | 1 64 144 144 | 1 64 144 144 | 86261760 |
26|TIDL_ConvolutionLayer |504 | 0| 1| 1| 25 x x x x x x x | 26 | 1 64 144 144 | 1 64 144 144 | 765739008 |
27|TIDL_EltWiseLayer |505 | 0| 2| 1| 24 26 x x x x x x | 27 | 1 64 144 144 | 1 64 144 144 | 1327104 |
28|TIDL_ConvolutionLayer |506 | 0| 1| 1| 27 x x x x x x x | 28 | 1 64 144 144 | 1 64 144 144 | 84934656 |
29|TIDL_ConcatLayer |508 | 0| 2| 1| 28 18 x x x x x x | 29 | 1 64 144 144 | 1 128 144 144 | 2654208 |
30|TIDL_BatchNormLayer |510 | 0| 1| 1| 29 x x x x x x x | 30 | 1 128 144 144 | 1 128 144 144 | 5308416 |
31|TIDL_ConvolutionLayer |513 | 0| 1| 1| 30 x x x x x x x | 31 | 1 128 144 144 | 1 128 144 144 | 342392832 |
32|TIDL_ConvolutionLayer |516 | 0| 1| 1| 31 x x x x x x x | 32 | 1 128 144 144 | 1 256 72 72 |1530150912 |
33|TIDL_ConvolutionLayer |632 | 0| 1| 1| 31 x x x x x x x | 33 | 1 128 144 144 | 1 64 144 144 | 171196416 |
34|TIDL_ConvolutionLayer |519 | 0| 1| 1| 32 x x x x x x x | 34 | 1 256 72 72 | 1 128 72 72 | 170532864 |
35|TIDL_ConvolutionLayer |542 | 0| 1| 1| 32 x x x x x x x | 35 | 1 256 72 72 | 1 128 72 72 | 169869312 |
36|TIDL_ConvolutionLayer |522 | 0| 1| 1| 34 x x x x x x x | 36 | 1 128 72 72 | 1 128 72 72 | 85598208 |
37|TIDL_ConvolutionLayer |525 | 0| 1| 1| 36 x x x x x x x | 37 | 1 128 72 72 | 1 128 72 72 | 765075456 |
38|TIDL_EltWiseLayer |526 | 0| 2| 1| 34 37 x x x x x x | 38 | 1 128 72 72 | 1 128 72 72 | 663552 |
39|TIDL_ConvolutionLayer |529 | 0| 1| 1| 38 x x x x x x x | 39 | 1 128 72 72 | 1 128 72 72 | 85598208 |
40|TIDL_ConvolutionLayer |532 | 0| 1| 1| 39 x x x x x x x | 40 | 1 128 72 72 | 1 128 72 72 | 765075456 |
41|TIDL_EltWiseLayer |533 | 0| 2| 1| 38 40 x x x x x x | 41 | 1 128 72 72 | 1 128 72 72 | 663552 |
42|TIDL_ConvolutionLayer |536 | 0| 1| 1| 41 x x x x x x x | 42 | 1 128 72 72 | 1 128 72 72 | 85598208 |
43|TIDL_ConvolutionLayer |539 | 0| 1| 1| 42 x x x x x x x | 43 | 1 128 72 72 | 1 128 72 72 | 765075456 |
44|TIDL_EltWiseLayer |540 | 0| 2| 1| 41 43 x x x x x x | 44 | 1 128 72 72 | 1 128 72 72 | 663552 |
45|TIDL_ConvolutionLayer |541 | 0| 1| 1| 44 x x x x x x x | 45 | 1 128 72 72 | 1 128 72 72 | 84934656 |
46|TIDL_ConcatLayer |543 | 0| 2| 1| 45 35 x x x x x x | 46 | 1 128 72 72 | 1 256 72 72 | 1327104 |
47|TIDL_BatchNormLayer |545 | 0| 1| 1| 46 x x x x x x x | 47 | 1 256 72 72 | 1 256 72 72 | 2654208 |
48|TIDL_ConvolutionLayer |548 | 0| 1| 1| 47 x x x x x x x | 48 | 1 256 72 72 | 1 256 72 72 | 341065728 |
49|TIDL_ConvolutionLayer |551 | 0| 1| 1| 48 x x x x x x x | 49 | 1 256 72 72 | 1 512 36 36 |1529487360 |
50|TIDL_ConvolutionLayer |605 | 0| 1| 1| 48 x x x x x x x | 50 | 1 256 72 72 | 1 128 72 72 | 170532864 |
51|TIDL_ConvolutionLayer |554 | 0| 1| 1| 49 x x x x x x x | 51 | 1 512 36 36 | 1 256 36 36 | 170201088 |
52|TIDL_ConvolutionLayer |563 | 0| 1| 1| 49 x x x x x x x | 52 | 1 512 36 36 | 1 256 36 36 | 169869312 |
53|TIDL_ConvolutionLayer |557 | 0| 1| 1| 51 x x x x x x x | 53 | 1 256 36 36 | 1 256 36 36 | 85266432 |
54|TIDL_ConvolutionLayer |560 | 0| 1| 1| 53 x x x x x x x | 54 | 1 256 36 36 | 1 256 36 36 | 764743680 |
55|TIDL_EltWiseLayer |561 | 0| 2| 1| 51 54 x x x x x x | 55 | 1 256 36 36 | 1 256 36 36 | 331776 |
56|TIDL_ConvolutionLayer |562 | 0| 1| 1| 55 x x x x x x x | 56 | 1 256 36 36 | 1 256 36 36 | 84934656 |
57|TIDL_ConcatLayer |564 | 0| 2| 1| 56 52 x x x x x x | 57 | 1 256 36 36 | 1 512 36 36 | 663552 |
58|TIDL_BatchNormLayer |566 | 0| 1| 1| 57 x x x x x x x | 58 | 1 512 36 36 | 1 512 36 36 | 1327104 |
59|TIDL_ConvolutionLayer |569 | 0| 1| 1| 58 x x x x x x x | 59 | 1 512 36 36 | 1 512 36 36 | 340402176 |
60|TIDL_ConvolutionLayer |572 | 0| 1| 1| 59 x x x x x x x | 60 | 1 512 36 36 | 1 256 36 36 | 170201088 |
61|TIDL_ConvolutionLayer |589 | 0| 1| 1| 59 x x x x x x x | 61 | 1 512 36 36 | 1 256 36 36 | 169869312 |
62|TIDL_ConvolutionLayer |575 | 0| 1| 1| 60 x x x x x x x | 62 | 1 256 36 36 | 1 256 36 36 | 764743680 |
63|TIDL_ConvolutionLayer |578 | 0| 1| 1| 62 x x x x x x x | 63 | 1 256 36 36 | 1 256 36 36 | 85266432 |
64|TIDL_PoolingLayer |579 | 0| 1| 1| 63 x x x x x x x | 64 | 1 256 36 36 | 1 256 36 36 | 331776 |
65|TIDL_PoolingLayer |580 | 0| 1| 1| 63 x x x x x x x | 65 | 1 256 36 36 | 1 256 36 36 | 2985984 |
66|TIDL_PoolingLayer |581 | 0| 1| 1| 63 x x x x x x x | 66 | 1 256 36 36 | 1 256 36 36 | 2985984 |
67|TIDL_ConcatLayer |582 | 0| 4| 1| 63 64 65 66 x x x x | 67 | 1 256 36 36 | 1 1024 36 36 | 1327104 |
68|TIDL_ConvolutionLayer |585 | 0| 1| 1| 67 x x x x x x x | 68 | 1 1024 36 36 | 1 256 36 36 | 340070400 |
69|TIDL_ConvolutionLayer |588 | 0| 1| 1| 68 x x x x x x x | 69 | 1 256 36 36 | 1 256 36 36 | 764743680 |
70|TIDL_ConcatLayer |590 | 0| 2| 1| 69 61 x x x x x x | 70 | 1 256 36 36 | 1 512 36 36 | 663552 |
71|TIDL_BatchNormLayer |592 | 0| 1| 1| 70 x x x x x x x | 71 | 1 512 36 36 | 1 512 36 36 | 1327104 |
72|TIDL_ConvolutionLayer |595 | 0| 1| 1| 71 x x x x x x x | 72 | 1 512 36 36 | 1 256 36 36 | 170201088 |
73|TIDL_ConvolutionLayer |598 | 0| 1| 1| 72 x x x x x x x | 73 | 1 256 36 36 | 1 128 36 36 | 42633216 |
74|TIDL_ResizeLayer |602 | 0| 1| 1| 73 x x x x x x x | 74 | 1 128 36 36 | 1 128 72 72 | 2654208 |
75|TIDL_ConcatLayer |606 | 0| 2| 1| 50 74 x x x x x x | 75 | 1 128 72 72 | 1 256 72 72 | 1327104 |
76|TIDL_ConvolutionLayer |609 | 0| 1| 1| 75 x x x x x x x | 76 | 1 256 72 72 | 1 128 72 72 | 170532864 |
77|TIDL_ConvolutionLayer |612 | 0| 1| 1| 76 x x x x x x x | 77 | 1 128 72 72 | 1 128 72 72 | 85598208 |
78|TIDL_ConvolutionLayer |616 | 0| 1| 1| 76 x x x x x x x | 78 | 1 128 72 72 | 1 128 72 72 | 84934656 |
79|TIDL_ConvolutionLayer |615 | 0| 1| 1| 77 x x x x x x x | 79 | 1 128 72 72 | 1 128 72 72 | 765075456 |
80|TIDL_ConcatLayer |617 | 0| 2| 1| 79 78 x x x x x x | 80 | 1 128 72 72 | 1 256 72 72 | 1327104 |
81|TIDL_BatchNormLayer |619 | 0| 1| 1| 80 x x x x x x x | 81 | 1 256 72 72 | 1 256 72 72 | 2654208 |
82|TIDL_ConvolutionLayer |622 | 0| 1| 1| 81 x x x x x x x | 82 | 1 256 72 72 | 1 128 72 72 | 170532864 |
83|TIDL_ConvolutionLayer |625 | 0| 1| 1| 82 x x x x x x x | 83 | 1 128 72 72 | 1 64 72 72 | 42799104 |
84|TIDL_ResizeLayer |629 | 0| 1| 1| 83 x x x x x x x | 84 | 1 64 72 72 | 1 64 144 144 | 5308416 |
85|TIDL_ConcatLayer |633 | 0| 2| 1| 33 84 x x x x x x | 85 | 1 64 144 144 | 1 128 144 144 | 2654208 |
86|TIDL_ConvolutionLayer |636 | 0| 1| 1| 85 x x x x x x x | 86 | 1 128 144 144 | 1 64 144 144 | 171196416 |
87|TIDL_ConvolutionLayer |639 | 0| 1| 1| 86 x x x x x x x | 87 | 1 64 144 144 | 1 64 144 144 | 86261760 |
88|TIDL_ConvolutionLayer |643 | 0| 1| 1| 86 x x x x x x x | 88 | 1 64 144 144 | 1 64 144 144 | 84934656 |
89|TIDL_ConvolutionLayer |642 | 0| 1| 1| 87 x x x x x x x | 89 | 1 64 144 144 | 1 64 144 144 | 765739008 |
90|TIDL_ConcatLayer |644 | 0| 2| 1| 89 88 x x x x x x | 90 | 1 64 144 144 | 1 128 144 144 | 2654208 |
91|TIDL_BatchNormLayer |646 | 0| 1| 1| 90 x x x x x x x | 91 | 1 128 144 144 | 1 128 144 144 | 5308416 |
92|TIDL_ConvolutionLayer |649 | 0| 1| 1| 91 x x x x x x x | 92 | 1 128 144 144 | 1 64 144 144 | 171196416 |
93|TIDL_ConvolutionLayer |655 | 0| 1| 1| 92 x x x x x x x | 93 | 1 64 144 144 | 1 128 72 72 | 382869504 |
94|TIDL_ConvolutionLayer |652 | 0| 1| 1| 92 x x x x x x x | 94 | 1 64 144 144 | 1 128 144 144 |1531478016 |
95|TIDL_ConcatLayer |656 | 0| 2| 1| 93 82 x x x x x x | 95 | 1 128 72 72 | 1 256 72 72 | 1327104 |
96|TIDL_ConvolutionLayer |699 | 0| 1| 1| 94 x x x x x x x | 96 | 1 128 144 144 | 1 255 144 144 | 676823040 |
97|TIDL_ConvolutionLayer |659 | 0| 1| 1| 95 x x x x x x x | 97 | 1 256 72 72 | 1 128 72 72 | 170532864 |
98|TIDL_DataLayer |699 | 0| 1| -1| 96 x x x x x x x | 0 | 1 255 144 144 | 0 0 0 0 | 0 |
99|TIDL_ConvolutionLayer |662 | 0| 1| 1| 97 x x x x x x x | 99 | 1 128 72 72 | 1 128 72 72 | 85598208 |
100|TIDL_ConvolutionLayer |666 | 0| 1| 1| 97 x x x x x x x |100 | 1 128 72 72 | 1 128 72 72 | 84934656 |
101|TIDL_ConvolutionLayer |665 | 0| 1| 1| 99 x x x x x x x |101 | 1 128 72 72 | 1 128 72 72 | 765075456 |
102|TIDL_ConcatLayer |667 | 0| 2| 1|101 100 x x x x x x |102 | 1 128 72 72 | 1 256 72 72 | 1327104 |
103|TIDL_BatchNormLayer |669 | 0| 1| 1|102 x x x x x x x |103 | 1 256 72 72 | 1 256 72 72 | 2654208 |
104|TIDL_ConvolutionLayer |672 | 0| 1| 1|103 x x x x x x x |104 | 1 256 72 72 | 1 128 72 72 | 170532864 |
105|TIDL_ConvolutionLayer |678 | 0| 1| 1|104 x x x x x x x |105 | 1 128 72 72 | 1 256 36 36 | 382537728 |
106|TIDL_ConvolutionLayer |675 | 0| 1| 1|104 x x x x x x x |106 | 1 128 72 72 | 1 256 72 72 |1530150912 |
107|TIDL_ConcatLayer |679 | 0| 2| 1|105 72 x x x x x x |107 | 1 256 36 36 | 1 512 36 36 | 663552 |
108|TIDL_ConvolutionLayer |700 | 0| 1| 1|106 x x x x x x x |108 | 1 256 72 72 | 1 255 72 72 | 338411520 |
109|TIDL_ConvolutionLayer |682 | 0| 1| 1|107 x x x x x x x |109 | 1 512 36 36 | 1 256 36 36 | 170201088 |
110|TIDL_DataLayer |700 | 0| 1| -1|108 x x x x x x x | 0 | 1 255 72 72 | 0 0 0 0 | 0 |
111|TIDL_ConvolutionLayer |685 | 0| 1| 1|109 x x x x x x x |111 | 1 256 36 36 | 1 256 36 36 | 85266432 |
112|TIDL_ConvolutionLayer |689 | 0| 1| 1|109 x x x x x x x |112 | 1 256 36 36 | 1 256 36 36 | 84934656 |
113|TIDL_ConvolutionLayer |688 | 0| 1| 1|111 x x x x x x x |113 | 1 256 36 36 | 1 256 36 36 | 764743680 |
114|TIDL_ConcatLayer |690 | 0| 2| 1|113 112 x x x x x x |114 | 1 256 36 36 | 1 512 36 36 | 663552 |
115|TIDL_BatchNormLayer |692 | 0| 1| 1|114 x x x x x x x |115 | 1 512 36 36 | 1 512 36 36 | 1327104 |
116|TIDL_ConvolutionLayer |695 | 0| 1| 1|115 x x x x x x x |116 | 1 512 36 36 | 1 256 36 36 | 170201088 |
117|TIDL_ConvolutionLayer |698 | 0| 1| 1|116 x x x x x x x |117 | 1 256 36 36 | 1 512 36 36 |1529487360 |
118|TIDL_ConvolutionLayer |701 | 0| 1| 1|117 x x x x x x x |118 | 1 512 36 36 | 1 255 36 36 | 169205760 |
119|TIDL_DataLayer |701 | 0| 1| -1|118 x x x x x x x | 0 | 1 255 36 36 | 0 0 0 0 | 0 |
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total Giga Macs : 34.4913
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------