SK-TDA4VM: Issue using tiovxisp plugin on gstreamer

Yogesh P Rao

Part Number: SK-TDA4VM

Hello all,

I am using the tiovxisp plugin with the gstreamer application. However, if I try to set a lower resolution (inside setup_cameras.sh) - to 640x480, and apply the setting and try to run the code with it, the plugin does not run. There is no error in the Log, but the Gstreamer does not set the pipeline to a playing state.

I presumed this to be an issue with my pipeline and decided to run the demo applications (Edge_AI) in the /opt/edge_ai_apps/apps_python directory by making changes to the resolution. This too failed. I looked at the Github Repo for the code - https://github.com/TexasInstruments/edgeai-gst-plugins/wiki/tiovxisp and ran the example pipeline with the new resolution of 640x480. This too failed.

I am not sure what is going wrong. I am using the imx219 sensor currently.

Could someone help with this?

over 3 years ago

0 Takuma Fujiwara over 3 years ago

TI__Guru 50403 points

Hi Yogesh,

Can you confirm that running the Edge AI demo application using rpiV2_cam_example.yaml as the configuration file with no changes (meaning 1920x1080 resolution) can be ran?

Regards,

Takuma

0 Takuma Fujiwara over 3 years ago in reply to Takuma Fujiwara

TI__Guru 50403 points

Hi Yogesh,

Nevermind, I see that this is related to a separate E2E thread: https://e2e.ti.com/support/processors-group/processors/f/processors-forum/1111323/sk-tda4vm-issue-with-setting-lower-resolution-on-gstreamer-pipeline

For clarification, the fix mentioned in this E2E thread is not working?

https://e2e.ti.com/support/processors-group/processors/f/processors-forum/1112142/sk-tda4vm-issue-with-framerate/4137377

Regards,

Takuma

0 Yogesh P Rao over 3 years ago in reply to Takuma Fujiwara

Prodigy 90 points

Hello Takuma,

Thank you for the reply! I fixed the framerate issue by editing the driver for imx219. However, the issue for tiovxisp still persists. I tried running the demo application at 1920x1080 with the plugin and it works fine. But if I change the resolution to any other resolution apart from 1920x1080, the plugin does not produce any output. There is no error, but neither the Demo application nor the Gstreamer Pipeline works.

Is there any way to solve this issue? I am not sure what is going wrong.

Thanks,
Yogesh

0 Takuma Fujiwara over 3 years ago in reply to Yogesh P Rao

TI__Guru 50403 points

Hi Yogesh,

I am checking internally on this, but so far I have gathered that it may be due to the files used for tuning the ISP is valid only for the specific resolution that it was tuned for.

Can I get a week to discuss with the team, determine whether this is the case, and hopefully provide a method to update these?

Regards,

Takuma

0 Takuma Fujiwara over 3 years ago in reply to Takuma Fujiwara

TI__Guru 50403 points

Hi Yogesh,

To generate the new binary files for ISP tuning:

1. Download PSDK RTOS: https://software-dl.ti.com/jacinto7/esd/processor-sdk-linux-sk-tda4vm/08_02_00/exports/docs/development_flow.html#getting-psdk-rtos

2. Replace the attached xml file in imaging/sensor_drv/src/imx219/dcc_xmls/

3. Run ./generate_dcc.sh

4. On the SK-TDA4VM, replace with the generated dcc_viss.bin and dcc_2a.bin in /opt/imaging/imx219/

5. Run the demo

Fullscreen imx219_h3a_aewb_dcc.xml Download

<?xml version="1.0" encoding="utf-8"?>
<VISS_H3A_AEWB_CFG xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema">
    <!--this is a comment-->
    <dcc_name>viss_h3a_aewb_cfg</dcc_name>
    <dcc_header>
        <camera_module_id>     219   </camera_module_id>
        <dcc_descriptor_id>    3    </dcc_descriptor_id>
        <algorithm_vendor_id>  1    </algorithm_vendor_id>
        <tunning_tool_version> 0    </tunning_tool_version>
    </dcc_header>
    <!--=======================================================================-->
    <typedef>
        <iss_h3a_grid_size type="struct">         
            <enable type="uint8"> </enable> <!-- enable h3a aewb-->
            <mode type="uint8"> </mode> <!-- 0 = SUM_SQ, 1=MINMAX, 2=SUM_ONLY-->
            <v_start type="uint16"> </v_start> <!-- Paxel_0 Start Coordinate Y in Pixels -->
            <h_start type="uint16"> </h_start> <!-- Paxel_0 Start Coordinate H in Pixels -->
            <v_size type="uint8"> </v_size> <!-- Paxel Height in Pixels -->
            <h_size type="uint8"> </h_size> <!-- Paxel Width in Pixels -->
            <v_count type="uint8"> </v_count> <!-- number of vertical paxels -->
            <h_count type="uint8"> </h_count> <!-- number of horizontal paxels -->
            <v_skip type="uint8"> </v_skip> <!--   vertical subsampling factor (0-15) -->
            <h_skip type="uint8"> </h_skip> <!--  horizontal subsampling factor (0-15) -->
            <saturation_limit type="uint16"> </saturation_limit> <!--  saturation_limit (0-1023) -->
            <blk_win_numlines type="uint16"> </blk_win_numlines> <!--  Win Height for the single black line of windows (2-256)-->
            <blk_row_vpos type="uint16"> </blk_row_vpos> <!--  Vertical Position of Black Row -->
            <sum_shift type="uint8"> </sum_shift> <!--  Sum Shift (0-15) -->
            <ALaw_En type="uint8"> </ALaw_En> <!--  A Law Enable (0/1) -->
            <MedFilt_En type="uint8"> </MedFilt_En> <!--  Median Filter Enable (0/1) -->
        </iss_h3a_grid_size>            
    </typedef>    
    <!--=======================================================================-->
    
    <use_case val="1023"> 
        <n-space>
            <region0 class="0">
                <gain             val="0" min="0" max="10240">  </gain>
                <exposure         val="1" min="0" max="10000000">  </exposure>
                <colortemperature val="2" min="0" max="10000">  </colortemperature>
            </region0>
        </n-space>
    
        <parameter_package>
            <h3a_aewb_dcc type="iss_h3a_grid_size">
                {
                       1,     // enable:   u8
                    
                       2,     // mode:     u8
                    
                       0,     // v_start:  u16
                       2,     // h_start:  u16
                    
                      28,     // v_size:   u8
                      38,     // h_size:   u8
                    
                      16,     // v_count:  u8
                      16,     // h_count:  u8
                    
                       1,     // v_skip:   u8
                       1,     // h_skip:   u8
                    
                    1000,     // saturation_limit: u16
                    
                       2,     // blk_win_numlines: u16
                     478,     // blk_row_vpos:     u16
                    
                       2,     // Sum Shift:   u8
                    
                       0,     // ALaw_En:     u8
                       0,     // MedFilt_En:  u8
                }
            </h3a_aewb_dcc>
        </parameter_package>
    </use_case>
    
    <!--=====================================================================-->
</VISS_H3A_AEWB_CFG>

Regards,

Takuma

0 Yogesh P Rao over 3 years ago in reply to Takuma Fujiwara

Prodigy 90 points

Hello Takuma,

I will do this. Thank you so much for the patch! Thank you for the reply. I will apply the patch to the RTOS SDK and update you once I replace the files.
Thank you once again for helping with this!

Regards,
Yogesh

0 Yogesh P Rao over 3 years ago in reply to Takuma Fujiwara

Prodigy 90 points

Hello Takuma,

I tried running the Gstreamer pipeline. But I get the following error:

1630.670056 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffffb5899f90 of type 00000816 at external count 1, internal count 0, releasing it
1630.670078 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=user_data_object_99) now as a part of garbage collection
1630.670159 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffffb589a1b0 of type 00000816 at external count 1, internal count 0, releasing it
1630.670170 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=user_data_object_100) now as a part of garbage collection
1630.670200 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffffb593c238 of type 00000813 at external count 1, internal count 0, releasing it
1630.670211 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=object_array_102) now as a part of garbage collection
1630.670224 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffffb589a5f0 of type 00000816 at external count 1, internal count 0, releasing it
1630.670233 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=user_data_object_103) now as a part of garbage collection
1630.670244 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffffb593c3d8 of type 00000813 at external count 1, internal count 0, releasing it
1630.670251 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=object_array_104) now as a part of garbage collection
1630.670263 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffffb58a7280 of type 00000817 at external count 1, internal count 0, releasing it
1630.670271 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=raw_image_105) now as a part of garbage collection
1630.670297 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffffb593c578 of type 00000813 at external count 1, internal count 0, releasing it
1630.670375 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=object_array_106) now as a part of garbage collection
1630.670391 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffffb589a810 of type 00000816 at external count 1, internal count 0, releasing it
1630.670400 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=user_data_object_107) now as a part of garbage collection
1630.670411 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffffb593c718 of type 00000813 at external count 1, internal count 0, releasing it
1630.670419 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=object_array_108) now as a part of garbage collection
1630.670430 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffffb58cf348 of type 0000080f at external count 1, internal count 0, releasing it
1630.670438 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=image_109) now as a part of garbage collection
1630.670496 s: VX_ZONE_INIT:[tivxHostDeInitLocal:100] De-Initialization Done for HOST !!!

The pipeline I am using is as follows:

gst-launch-1.0 v4l2src device=/dev/video2 ! queue leaky=2 ! video/x-bayer, width=640, height=480, format=rggb, framerate=30/1 ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a.bin format-msb=7 ! video/x-raw, format=NV12 ! fakesink

Do I need to rebuild the gstreamer and tiovx plugins once I copy the dcc bin files?

Regards,
Yogesh

0 Yogesh P Rao over 3 years ago in reply to Yogesh P Rao

Prodigy 90 points

Hello Takuma,

This is the error I am getting:

68.871107 s: VX_ZONE_ERROR:[ownContextSendCmd:815] Command ack message ret0
    68.871153 s: VX_ZONE_ERROR:[ownContextSendCmd:851] tivxEventWait() failed.
    68.871161 s: VX_ZONE_ERROR:[ownNodeKernelInit:538] Target kernel, TIVX_CMD0
    68.871167 s: VX_ZONE_ERROR:[ownNodeKernelInit:539] Please be sure the targe
    68.871173 s: VX_ZONE_ERROR:[ownNodeKernelInit:540] If the target callbacksl
    68.871180 s: VX_ZONE_ERROR:[ownGraphNodeKernelInit:583] kernel init for no!
    68.871189 s: VX_ZONE_ERROR:[vxVerifyGraph:2055] Node kernel init failed
    68.871195 s: VX_ZONE_ERROR:[vxVerifyGraph:2109] Graph verify failed
    68.871464 s: VX_ZONE_ERROR:[ownReleaseReferenceInt:307] Invalid reference
ERROR: from element /GstPipeline:pipeline0/GstTIOVXISP:tiovxisp0: Unable to inie
Additional debug info:
../gst-libs/gst/tiovx/gsttiovxmiso.c(1409): gst_tiovx_miso_negotiated_src_caps 0

The pipeline I am using:

gst-launch-1.0 v4l2src device=/dev/video2 num-buffers=300 ! queue leaky=2 ! video/x-bayer, width=640, height=480, format=rggb, framerate=30/1 ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a.bin format-msb=7 ! video/x-raw, format=NV12 ! tiovxcolorconvert ! video/x-raw, format=I420, width=640, height=480, framerate=30/1 ! timeoverlay ! rawvideoparse ! filesink location=output.yuv

I am not sure how to proceed.

Regards,
Yogesh

0 Takuma Fujiwara over 3 years ago in reply to Yogesh P Rao

TI__Guru 50403 points

Hi Yogesh,

For debug purposes, could you run the default pipeline (1920 x 1080) with the new binaries for the ISP?

Regards,

Takuma

0 Yogesh P Rao over 3 years ago in reply to Takuma Fujiwara

Prodigy 90 points

Hi Takuma,

Thank you so much for the help and patient responses!

I ran it with the default pipeline and faced the same error output. I obtained the default pipeline from the console messages of the demo code.

I re-flashed the board with a fresh image and copied the binaries generated from the RTOS SDK to the board. I then ran the setup_script.sh. Then I ran the Demo code and the error message was the same as above.

Regards,

Yogesh

0 Yogesh P Rao over 3 years ago in reply to Yogesh P Rao

Prodigy 90 points

Hello Takuma,

Here is the output for the demo app -

Final number of subgraphs created are : 1, - Offloaded Nodes - 517, Total Nodes - 517
APP: Init ... !!!
MEM: Init ... !!!
MEM: Initialized DMA HEAP (fd=4) !!!
MEM: Init ... Done !!!
IPC: Init ... !!!
IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
   313.207144 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
   313.210556 s: VX_ZONE_INIT:Enabled
   313.210783 s: VX_ZONE_ERROR:Enabled
   313.210853 s: VX_ZONE_WARNING:Enabled
   313.214001 s: VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
   313.216216 s: VX_ZONE_INIT:[tivxHostInitLocal:86] Initialization Done for HOST !!!
[GST SRC STR]
[FLOW 0]
v4l2src device=/dev/video2 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a.bin format-msb=7 ! video/x-raw, format=NV12 !tiovxmultiscaler name=split_01
split_01. ! queue ! video/x-raw, width=512, height=512 ! tiovxdlpreproc data-type=3 target=0 channel-order=0 tensor-format=bgr out-pool-size=4 ! application/x-tensor-tiovx ! appsink name=pre_0 max-buffers=2 drop=true
split_01. ! queue ! video/x-raw, width=1280, height=720 ! tiovxdlcolorconvert target=1 out-pool-size=4 ! video/x-raw, format=RGB ! appsink name=sen_0 max-buffers=2 drop=true

[GST SINK STR]
appsrc format=GST_FORMAT_TIME is-live=true block=true do-timestamp=true name=post_0 ! tiovxdlcolorconvert ! video/x-raw,format=NV12, width=1280, height=720 ! queue ! mosaic_0.sink_0
tiovxmosaic name=mosaic_0 background=/tmp/background_0
sink_0::startx=320 sink_0::starty=180 sink_0::width=1280   sink_0::height=720
! video/x-raw,format=NV12, width=1920, height=1080 ! kmssink sync=false driver-name=tidss

   319.553412 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff9e187a90 of type 00000816 at external count 1, internal count 0, releasing it
   319.553442 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=user_data_object_157) now as a part of garbage collection
   319.553500 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff9e187cb0 of type 00000816 at external count 1, internal count 0, releasing it
   319.553523 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=user_data_object_158) now as a part of garbage collection
   319.553565 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff9e22ad38 of type 00000813 at external count 1, internal count 0, releasing it
   319.553587 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=object_array_160) now as a part of garbage collection
   319.553610 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff9e1880f0 of type 00000816 at external count 1, internal count 0, releasing it
   319.553628 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=user_data_object_161) now as a part of garbage collection
   319.553648 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff9e22aed8 of type 00000813 at external count 1, internal count 0, releasing it
   319.553665 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=object_array_162) now as a part of garbage collection
   319.553685 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff9e193ea0 of type 00000817 at external count 1, internal count 0, releasing it
   319.553702 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=raw_image_163) now as a part of garbage collection
   319.553746 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff9e22b078 of type 00000813 at external count 1, internal count 0, releasing it
   319.553771 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=object_array_164) now as a part of garbage collection
   319.553794 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff9e188310 of type 00000816 at external count 1, internal count 0, releasing it
   319.553811 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=user_data_object_165) now as a part of garbage collection
   319.553830 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff9e22b218 of type 00000813 at external count 1, internal count 0, releasing it
   319.553847 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=object_array_166) now as a part of garbage collection
   319.553868 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff9e1beae8 of type 0000080f at external count 1, internal count 0, releasing it
   319.553886 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=image_167) now as a part of garbage collection
   319.553950 s: VX_ZONE_INIT:[tivxHostDeInitLocal:100] De-Initialization Done for HOST !!!
   319.558402 s: VX_ZONE_INIT:[tivxDeInitLocal:193] De-Initialization Done !!!
APP: Deinit ... !!!
REMOTE_SERVICE: Deinit ... !!!
REMOTE_SERVICE: Deinit ... Done !!!
IPC: Deinit ... !!!
IPC: DeInit ... Done !!!
MEM: Deinit ... !!!
MEM: Alloc's: 62 alloc's of 106385343 bytes
MEM: Free's : 62 free's of 106385343 bytes
MEM: Open's : 0 allocs of 0 bytes
MEM: Deinit ... Done !!!
APP: Deinit ... Done !!!

Regards,
Yogesh

0 Takuma Fujiwara over 3 years ago in reply to Yogesh P Rao

TI__Guru 50403 points

Hi Yogesh,

For testing with the default resolution, can you confirm that changes made to camera initialization script are also update for 1080p? If everything is set up and the error still persists, then it is most likely something wrong with the tuning binaries.

Could you give me until next Tuesday to consult with ISP expert and recreate issue on my end?

Regards,

Takuma

0 Yogesh P Rao over 3 years ago in reply to Takuma Fujiwara

Prodigy 90 points

Hi Takuma,

Thank you for the response. I have attached the settings and the logs after I ran the demo application:

Here are the logs:

root@tda4vm-sk:/opt/edge_ai_apps/apps_python# ./app_edgeai.py ../configs/rpiV2_cam_example.yaml
libtidl_onnxrt_EP loaded 0x309a6e90
Final number of subgraphs created are : 1, - Offloaded Nodes - 517, Total Nodes - 517
APP: Init ... !!!
MEM: Init ... !!!
MEM: Initialized DMA HEAP (fd=4) !!!
MEM: Init ... Done !!!
IPC: Init ... !!!
IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
   170.888176 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
   170.891694 s: VX_ZONE_INIT:Enabled
   170.891718 s: VX_ZONE_ERROR:Enabled
   170.891742 s: VX_ZONE_WARNING:Enabled
   170.894336 s: VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
   170.896375 s: VX_ZONE_INIT:[tivxHostInitLocal:86] Initialization Done for HOST !!!
[GST SRC STR]
[FLOW 0]
v4l2src device=/dev/video2 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a.bin format-msb=7 ! video/x-raw, format=NV12 !tiovxmultiscaler name=split_01
split_01. ! queue ! video/x-raw, width=512, height=512 ! tiovxdlpreproc data-type=3 target=0 channel-order=0 tensor-format=bgr out-pool-size=4 ! application/x-tensor-tiovx ! appsink name=pre_0 max-buffers=2 drop=true
split_01. ! queue ! video/x-raw, width=1280, height=720 ! tiovxdlcolorconvert target=1 out-pool-size=4 ! video/x-raw, format=RGB ! appsink name=sen_0 max-buffers=2 drop=true

[GST SINK STR]
appsrc format=GST_FORMAT_TIME is-live=true block=true do-timestamp=true name=post_0 ! tiovxdlcolorconvert ! video/x-raw,format=NV12, width=1280, height=720 ! queue ! mosaic_0.sink_0
tiovxmosaic name=mosaic_0 background=/tmp/background_0
sink_0::startx=320 sink_0::starty=180 sink_0::width=1280   sink_0::height=720
! video/x-raw,format=NV12, width=1920, height=1080 ! kmssink sync=false driver-name=tidss

   177.452725 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff83fc7a90 of type 00000816 at external count 1, internal count 0, releasing it
   177.452754 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=user_data_object_151) now as a part of garbage collection
   177.452794 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff83fc7cb0 of type 00000816 at external count 1, internal count 0, releasing it
   177.452807 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=user_data_object_152) now as a part of garbage collection
   177.452836 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff8406ad38 of type 00000813 at external count 1, internal count 0, releasing it
   177.452847 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=object_array_154) now as a part of garbage collection
   177.452859 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff83fc80f0 of type 00000816 at external count 1, internal count 0, releasing it
   177.452869 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=user_data_object_155) now as a part of garbage collection
   177.452880 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff8406aed8 of type 00000813 at external count 1, internal count 0, releasing it
   177.452889 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=object_array_156) now as a part of garbage collection
   177.452901 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff83fd3ea0 of type 00000817 at external count 1, internal count 0, releasing it
   177.452909 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=raw_image_157) now as a part of garbage collection
   177.452945 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff8406b078 of type 00000813 at external count 1, internal count 0, releasing it
   177.452955 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=object_array_163) now as a part of garbage collection
   177.452965 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff83fc8310 of type 00000816 at external count 1, internal count 0, releasing it
   177.452970 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=user_data_object_165) now as a part of garbage collection
   177.452982 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff8406b218 of type 00000813 at external count 1, internal count 0, releasing it
   177.452990 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=object_array_166) now as a part of garbage collection
   177.453002 s: VX_ZONE_WARNING:[vxReleaseContext:1050] Found a reference 0xffff83ffeae8 of type 0000080f at external count 1, internal count 0, releasing it
   177.453011 s: VX_ZONE_WARNING:[vxReleaseContext:1052] Releasing reference (name=image_167) now as a part of garbage collection
   177.453069 s: VX_ZONE_INIT:[tivxHostDeInitLocal:100] De-Initialization Done for HOST !!!
   177.457483 s: VX_ZONE_INIT:[tivxDeInitLocal:193] De-Initialization Done !!!
APP: Deinit ... !!!
REMOTE_SERVICE: Deinit ... !!!
REMOTE_SERVICE: Deinit ... Done !!!
IPC: Deinit ... !!!
IPC: DeInit ... Done !!!
MEM: Deinit ... !!!
MEM: Alloc's: 62 alloc's of 106385343 bytes
MEM: Free's : 62 free's of 106385343 bytes
MEM: Open's : 0 allocs of 0 bytes
MEM: Deinit ... Done !!!
APP: Deinit ... Done !!!

It gives the same error and exits.

Regards,
Yogesh

+1 Takuma Fujiwara over 3 years ago in reply to Yogesh P Rao

TI__Guru 50403 points

Hi Yogesh,

Apologies for the delay. I had a live debug session with the ISP expert and we were able to generate a set of binaries that should work which I attached to this post.

The process we used for getting a smaller resolution stream from IMX219 is:

Copy and unzip new binary files to SK-TDA4VM
Update setup_camera.sh CSI_CAM_0_FMT to use 640x480.
Run setup_camera.sh
Run the following command to create a pipeline of just the IMX219 camera (please change the binary location if using this to test): gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-bayer, width=640, height=480, format=rggb ! \
tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/home/root/dcc_bin_1/dcc_viss.bin \
sink_0::dcc-2a-file=/home/root/dcc_bin_1/dcc_2a.bin format-msb=7 ! autovideosink

.640x480_imx219_binaries.zip

With the above we were able to display a camera stream of lower resolution to the display.

Regards,

Takuma

0 Yogesh P Rao over 3 years ago in reply to Takuma Fujiwara

Prodigy 90 points

Hello Takuma,

Firstly - I want to thank you immensely for patiently responding and trying to resolve my issues and queries. I am very pleased to let you know that it worked. It runs and the binary files work for 640x480 as well as 1920x1080.

Thank you so much! Thanks a lot to all your team for the effort and for the resolution.

The pipeline needs to be modified a bit - I used :

gst-launch-1.0 v4l2src device=/dev/video2 ! queue leaky=2 ! video/x-bayer, width=640, height=480, format=rggb, framerate=30/1 ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/home/root/640x480_imx219_binaries/dcc_viss.bin sink_0::dcc-2a-file=/home/root/640x480_imx219_binaries/dcc_2a.bin format-msb=7 ! video/x-raw, format=NV12 ! kmssink sync=false driver-name=tidss -v

I later modified the imx219 driver to run at 105 fps. I was able to use your binaries and work then too - although the framerate took a bit of a drop.

Thanks to you and your team once again.

Regards,
Yogesh

Processors

Processors forum

SK-TDA4VM: Issue using tiovxisp plugin on gstreamer