Part Number: AM2632
Other Parts Discussed in Thread: SYSCONFIG
To reduce system startup time when using HSM, can we disable the HSMRT & APP image verification step in the SBL code? 
You cannot disable the HSMRT verification as this is done by ROM.
You can either not load the HSMRT if you are not using the M4 core.
You can disable the verification of App image. If you are using Bootloader_parseAndLoadMultiCoreELF to load the image then you would have to modify the below struct member .isAppimageSigned to False to not authenticate the image.

Hello Nikhil,
How can I change "isAppimageSigned" to "false"? I seem not to have found it in the sysconfig.