I have recently had cause to recompile TIDL (tidl_j721e_08_05_00_16, as found with RTOS SDK 08_05_00_11), and have found a number of bugs. I've created patch files which I have attached to shared my fixes. I've also verified that most of these are still extant in the later SDK version (08_06_00_12).
Many of these bugs cause segmentation faults with TIDL is built with modern compilers. Also many generate warnings, but are often suppressed in the Makefiles.
Most of the bugs are due to missing return statements at the end of functions (which with anything more than O1 optimisation will segfault due probably due to leaf function optimisations etc.), although there's also at least one array overrun (both read and write beyond the end of the array).
See attached patches for full details. Please feed these back to the relevant development teams.