This thread has been locked.
If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.
Tool/software:
Hello,
I am currently working on TDAEntry board to work with 8MP RGBIR sensor. This camera has a 4X4 CFA pattern and since entry board allows to work with these sensors, could you kindly help me by providing some resources or direction on how I can work on this. The goal is to update the current single cam app within SDK.
Hello,
Yes, TDA4VEN VPAC can natively support RGB-IR with 4x4 pattern. What HLOS and SDK version are you using?
Thank you,
Fabiana
we are using Linux sdk version 10_00_00_05. Do we have to change specific config files or graph parameters in default single cam app provided with sdk to work with this sensor?
We updated sensor driver for AR0823 and ran single cam app, error logs of the run are mentioned in the text file attached. Seems like we need to update parameters within default single cam app graph to enable RGBIR processing. Kindly help us by mentioning what changes are to be done.
One assumption we are thinking of is to change viss_params object to enable PCID. please let us know if any similar changes are to be done.
root@j722s-evm:/opt/vision_apps# ./run_app_single_cam.sh APP: Init ... !!! 397.936871 s: MEM: Init ... !!! 397.937000 s: MEM: Initialized DMA HEAP (fd=5) !!! 397.937240 s: MEM: Init ... Done !!! 397.937262 s: IPC: Init ... !!! 397.993879 s: IPC: Init ... Done !!! REMOTE_SERVICE: Init ... !!! REMOTE_SERVICE: Init ... Done !!! 398.005818 s: GTC Frequency = 200 MHz APP: Init ... Done !!! 398.011052 s: VX_ZONE_INIT:Enabled 398.011110 s: VX_ZONE_ERROR:Enabled 398.011121 s: VX_ZONE_WARNING:Enabled 398.013711 s: VX_ZONE_INIT:[tivxPlatformCreateTargetId:124] Added target MPU-0 398.013913 s: VX_ZONE_INIT:[tivxPlatformCreateTargetId:124] Added target MPU-1 398.014036 s: VX_ZONE_INIT:[tivxPlatformCreateTargetId:124] Added target MPU-2 398.014178 s: VX_ZONE_INIT:[tivxPlatformCreateTargetId:124] Added target MPU-3 398.014195 s: VX_ZONE_INIT:[tivxInitLocal:136] Initialization Done !!! 398.016213 s: VX_ZONE_INIT:[tivxHostInitLocal:106] Initialization Done for HOST !!! sensor_selection = [0] ldc_enable = [0] num_frames_to_run = [1000000000] is_interactive = [1] IttCtrl_registerHandler: command echo registered at location 0 IttCtrl_registerHandler: command iss_read_2a_params registered at location 1 IttCtrl_registerHandler: command iss_write_2a_params registered at location 2 IttCtrl_registerHandler: command iss_raw_save registered at location 3 IttCtrl_registerHandler: command iss_yuv_save registered at location 4 IttCtrl_registerHandler: command iss_read_sensor_reg registered at location 5 IttCtrl_registerHandler: command iss_write_sensor_reg registered at location 6 IttCtrl_registerHandler: command dev_ctrl registered at location 7 IttCtrl_registerHandler: command iss_send_dcc_file registered at location 8 NETWORK: Opened at IP Addr = 111.116.101.112, socket port=5000!!! 398.025247 s: ISS: Enumerating sensors ... !!! [MCU2_0] 398.025357 s: ImageSensor_RemoteServiceHandler: IM_SENSOR_CMD_ENUMERATE [MCU2_0] 398.025389 s: Fusion1 Board configuration [MCU2_0] 398.025474 s: Write 0x01 to TCA9543APWR (0x70) successful!!! [MCU2_0] 398.025497 s: Deserializer config start [MCU2_0] 398.225772 s: End of deserializer config [MCU2_0] 398.225788 s: Deserializer config start 398.425929 s: ISS: Enumerating sensors ... found 0 : IMX390-UB953_D3 398.425986 s: ISS: Enumerating sensors ... found 1 : IMX390-UB953-DISCOVERY-NARROW 398.425999 s: ISS: Enumerating sensors ... found 2 : IMX390-UB953-DISCOVERY-MID 398.426010 s: ISS: Enumerating sensors ... found 3 : IMX390-UB953-DISCOVERY-WIDE 398.426020 s: ISS: Enumerating sensors ... found 4 : AR0233-UB953_MARS 398.426030 s: ISS: Enumerating sensors ... found 5 : AR0820-UB953_LI 398.426040 s: ISS: Enumerating sensors ... found 6 : AR0823-UB953_MARS 398.426050 s: ISS: Enumerating sensors ... found 7 : UB9xxx_RAW12_TESTPATTERN 398.426061 s: ISS: Enumerating sensors ... found 8 : UB96x_UYVY_TESTPATTERN 398.426071 s: ISS: Enumerating sensors ... found 9 : GW_AR0233_UYVY Select camera port index 0-11 : [MCU2_0] 398.425786 s: End of deserializer config 2 10 registered sensor drivers a : IMX390-UB953_D3 b : IMX390-UB953-DISCOVERY-NARROW c : IMX390-UB953-DISCOVERY-MID d : IMX390-UB953-DISCOVERY-WIDE e : AR0233-UB953_MARS f : AR0820-UB953_LI g : AR0823-UB953_MARS h : UB9xxx_RAW12_TESTPATTERN i : UB96x_UYVY_TESTPATTERN j : GW_AR0233_UYVY Select a sensor above or press '0' to autodetect the sensor : Invalid selection . Try again 10 registered sensor drivers a : IMX390-UB953_D3 b : IMX390-UB953-DISCOVERY-NARROW c : IMX390-UB953-DISCOVERY-MID d : IMX390-UB953-DISCOVERY-WIDE e : AR0233-UB953_MARS f : AR0820-UB953_LI g : AR0823-UB953_MARS h : UB9xxx_RAW12_TESTPATTERN i : UB96x_UYVY_TESTPATTERN j : GW_AR0233_UYVY Select a sensor above or press '0' to autodetect the sensor : 0 [MCU2_0] 408.520431 s: Deserializer config start [MCU2_0] 408.524433 s: End of deserializer config [MCU2_0] 408.524449 s: ub953 config start : slaveAddr = 0x78 [MCU2_0] 408.714453 s: End of UB953 config [MCU2_0] 408.714606 s: Failing while transmitting the rd reg addr with error code - -4 [MCU2_0] 408.714626 s: Error : I2C Timeout while reading from IMX390 register 0x330 [MCU2_0] 408.714642 s: IMX390 Probe : Failed to read CHIP_ID register 0x330 [MCU2_0] 408.714686 s: Configuring Alias on UB960 CHID: 2, aliasing 0x21 to 0x44 [MCU2_0] 408.714900 s: Deserializer config start [MCU2_0] 408.716450 s: End of deserializer config [MCU2_0] 408.716483 s: Configuring Alias on UB960 CHID: 2, aliasing 0x70 to 0x52 [MCU2_0] 408.716693 s: Deserializer config start [MCU2_0] 408.718449 s: End of deserializer config [MCU2_0] 408.718758 s: IMX390 Error: Configuring PCAL for Reset line of ch 2 returned -4 [MCU2_0] 408.718794 s: Configuring Alias on UB960 CHID: 2, aliasing 0x21 to 0x44 [MCU2_0] 408.719005 s: Deserializer config start [MCU2_0] 408.720450 s: End of deserializer config [MCU2_0] 408.720481 s: Configuring Alias on UB960 CHID: 2, aliasing 0x70 to 0x52 [MCU2_0] 408.720691 s: Deserializer config start [MCU2_0] 408.722450 s: End of deserializer config [MCU2_0] 408.722757 s: IMX390 Error: Configuring PCAL for Reset line of ch 2 returned -4 [MCU2_0] 408.722792 s: Configuring Alias on UB960 CHID: 2, aliasing 0x21 to 0x44 [MCU2_0] 408.723001 s: Deserializer config start [MCU2_0] 408.724450 s: End of deserializer config [MCU2_0] 408.724481 s: Configuring Alias on UB960 CHID: 2, aliasing 0x70 to 0x52 [MCU2_0] 408.724689 s: Deserializer config start [MCU2_0] 408.726450 s: End of deserializer config [MCU2_0] 408.726756 s: IMX390 Error: Configuring PCAL for Reset line of ch 2 returned -4 [MCU2_0] 408.726888 s: Deserializer config start [MCU2_0] 408.730450 s: End of deserializer config [MCU2_0] 408.830378 s: ub953 config start : slaveAddr = 0x78 [MCU2_0] 409.835544 s: End of UB953 config [MCU2_0] 409.936722 s: AR0233_Probe : 0xe54 read at chip ID register 0x3000. Expected 0x956 [MCU2_0] 409.936745 s: AR0233 Probe Failed [MCU2_0] 410.037729 s: AR0233_Probe : 0xe54 read at chip ID register 0x3000. Expected 0x956 [MCU2_0] 410.037749 s: AR0233 Probe Failed [MCU2_0] 410.138735 s: AR0233_Probe : 0xe54 read at chip ID register 0x3000. Expected 0x956 [MCU2_0] 410.138754 s: AR0233 Probe Failed [MCU2_0] 410.239744 s: AR0233_Probe : 0xe54 read at chip ID register 0x3000. Expected 0x956 [MCU2_0] 410.239764 s: AR0233 Probe Failed [MCU2_0] 410.340753 s: AR0233_Probe : 0xe54 read at chip ID register 0x3000. Expected 0x956 [MCU2_0] 410.340772 s: AR0233 Probe Failed [MCU2_0] 410.440622 s: Deserializer config start [MCU2_0] 410.444587 s: End of deserializer config [MCU2_0] 410.544515 s: ub953 config start : slaveAddr = 0x78 [MCU2_0] 411.546681 s: End of UB953 config [MCU2_0] 411.647859 s: AR0820_Probe : 0xe54 read at chip ID register 0x3000. Expected 0x557 [MCU2_0] 411.647882 s: AR0820 Probe Failed [MCU2_0] 411.748866 s: AR0820_Probe : 0xe54 read at chip ID register 0x3000. Expected 0x557 [MCU2_0] 411.748886 s: AR0820 Probe Failed [MCU2_0] 411.849875 s: AR0820_Probe : 0xe54 read at chip ID register 0x3000. Expected 0x557 [MCU2_0] 411.849895 s: AR0820 Probe Failed [MCU2_0] 411.950882 s: AR0820_Probe : 0xe54 read at chip ID register 0x3000. Expected 0x557 [MCU2_0] 411.950902 s: AR0820 Probe Failed [MCU2_0] 412.051890 s: AR0820_Probe : 0xe54 read at chip ID register 0x3000. Expected 0x557 [MCU2_0] 412.051910 s: AR0820 Probe Failed [MCU2_0] 412.151761 s: Deserializer config start [MCU2_0] 412.155724 s: End of deserializer config [MCU2_0] 412.255652 s: ub953 config start : slaveAddr = 0x78 [MCU2_0] 413.257817 s: End of UB953 config Sensor selected : AR0823-UB953_MARS LDC Selection Yes(1)/No(0) : LDC Selection Yes(1)/No(0) : [MCU2_0] 413.358996 s: AR0823_Probe SUCCESS : Read expe cted value 0xe54 at chip ID register 0x3000 [MCU2_0] 413.360269 s: AR0823 Sensor Revision ID = 0x22 [MCU2_0] 413.360284 s: Found sensor AR0823-UB953_MARS at port # 2 [MCU2_0] 413.360299 s: IM_SENSOR_CMD_DETECT : Found sensor 6 at port 2 0 CAC Selection Yes(1)/No(0) : CAC Selection Yes(1)/No(0) : 0 Querying AR0823-UB953_MARS 430.489737 s: ISS: Querying sensor [AR0823-UB953_MARS] ... !!! 430.489904 s: ISS: Querying sensor [AR0823-UB953_MARS] ... Done !!! 430.489925 s: ISS: Initializing sensor [AR0823-UB953_MARS], doing IM_SENSOR_CMD_PWRON ... !!! 430.490029 s: ISS: Initializing sensor [AR0823-UB953_MARS], doing IM_SENSOR_CMD_CONFIG ... !!! [MCU2_0] 430.489810 s: ImageSensor_RemoteServiceHandler: IM_SENSOR_CMD_QUERY [MCU2_0] 430.489828 s: Received Query for AR0823-UB953_MARS [MCU2_0] 430.489957 s: ImageSensor_RemoteServiceHandler: IM_SENSOR_CMD_PWRON [MCU2_0] 430.489974 s: IM_SENSOR_CMD_PWRON : channel_mask = 0x04 [MCU2_0] 430.490063 s: ImageSensor_RemoteServiceHandler: IM_SENSOR_CMD_CONFIG [MCU2_0] 430.490078 s: Application requested features = 0x158 [MCU2_0] [MCU2_0] 430.490094 s: Disabling broadcast mode [MCU2_0] 430.490111 s: Deserializer config start [MCU2_0] 430.746212 s: End of deserializer config [MCU2_0] 430.746227 s: Deserializer config start [MCU2_0] 431.002232 s: End of deserializer config [MCU2_0] 431.002245 s: IM_SENSOR_CMD_CONFIG channel_mask = 04 [MCU2_0] 431.002377 s: Deserializer config start [MCU2_0] 431.006232 s: End of deserializer config [MCU2_0] 431.106160 s: ub953 config start : slaveAddr = 0x78 [MCU2_0] 432.108325 s: End of UB953 config 432.210965 s: ISS: ERROR: Initializing sensor [AR0823-UB953_MARS] failed !!! 432.211026 s: ISS: Initializing sensor [AR0823-UB953_MARS] ... Done !!! Error initializing sensor AR0823-UB953_MARS [MCU2_0] 432.209502 s: AR0823_Probe SUCCESS : Read expected value 0xe54 at chip ID register 0x3000 [MCU2_0] 432.210774 s: AR0823 Sensor Revision ID = 0x22 [MCU2_0] 432.210789 s: Configuring camera # 2 [MCU2_0] 432.210821 s: IssSensor_Config Error : Incorrect channel ID 2 [MCU2_0] 432.210836 s: IM_SENSOR_CMD_CONFIG returning status = -1 read_test_image_raw : Unable to open file /opt/vision_apps/test_data/img_test.raw app_create_viss : sensor_dcc_id = 823 Scaler is enabled 434.254082 s: ISS: Starting sensor [AR0823-UB953_MARS] ... !!! [MCU2_0] 434.254293 s: ImageSensor_RemoteServiceHandler: IM_SENSOR_CMD_STREAM_ON [MCU2_0] 434.254341 s: IM_SENSOR_CMD_STREAM_ON: channel_mask = 0x04 [MCU2_0] 434.254364 s: Deserializer config start [MCU2_0] 434.510514 s: End of deserializer config [MCU2_0] 434.510535 s: Deserializer config start 434.767234 s: ISS: Starting sensor [AR0823-UB953_MARS] failed !!! Failed to start sensor AR0823-UB953_MARS Defaulting to file test mode ========================== Demo : Single Camera w/ 2A ========================== p: Print performance statistics s: Save Sensor RAW, VISS Output and H3A output images to File System e: Export performance statistics u: Update DCC from File System x: Exit Enter Choice: Unsupported command ========================== Demo : Single Camera w/ 2A ========================== p: Print performance statistics s: Save Sensor RAW, VISS Output and H3A output images to File System e: Export performance statistics u: Update DCC from File System x: Exit Enter Choice: get_dcc_dir_size : Could not open directory or directory is empty /opt/vision_apps/dcc/AR0823-UB953_M ARS/wdr [MCU2_0] 434.766533 s: End of deserializer config [MCU2_0] 434.767073 s: AR0823_WriteReg : Error writing to register 0x100 [MCU2_0] 434.767104 s: Error : Failed to start sensor at channel Id 2 [MCU2_0] 435.267496 s: RTOS DPL ERROR: Semaphore wait failed. Timeout expired. [MCU2_0] 435.300506 s: RTOS DPL ERROR: Semaphore wait failed. Timeout expired. [MCU2_0] 435.333507 s: RTOS DPL ERROR: Semaphore wait failed. Timeout expired. [MCU2_0] 435.366508 s: RTOS DPL ERROR: Semaphore wait failed. Timeout expired. [MCU2_0] 435.399510 s: RTOS DPL ERROR: Semaphore wait failed. Timeout expired. [MCU2_0] 435.432514 s: RTOS DPL ERROR: Semaphore wait failed. Timeout expired. [MCU2_0] 435.465516 s: RTOS DPL ERROR: Semaphore wait failed. Timeout expired. [MCU2_0] 435.498520 s: RTOS DPL ERROR: Semaphore wait failed. Timeout expired.
