TIDL quantization about "numParamBits" and "numFeatureBits"

Hi,

   numParamBits and numFeatureBits control how many bits are used for quantization for parameters and features/activation respectively. It is important to note that if you make any of them greater than 8 bit the other one will automatically become 16 bit.

user6352935 said:

Is it recomended using 8bit for runtime ? Why ?

Yes 8 bit quantization is recommended and the reason is because you will get the best performance for 8 bit. For example TDA4VM can give 8 TOPS for 8 bit where as it becomes 2 TOPS for 16 bit. If you are observing any issues with 8 bit quantization then please follow the steps in the below documentation to see how it can be improved  : 

https://software-dl.ti.com/jacinto7/esd/processor-sdk-rtos-jacinto7/latest/exports/docs/tidl_j7_02_00_00_07/ti_dl/docs/user_guide_html/md_tidl_fsg_steps_to_debug_mismatch.html

Regards,

Anshu