PROCESSOR-SDK-AM62A: Error in adding 4k video stream by adding bin files

Sajan Saji

Tool/software:

Hello Expert,

I am using AM62a with IMX219 8MP camera connected via Arducam v3Link adapter board.

In 1080p (IMX219_CAM_FMT="${IMX219_CAM_FMT:-[fmt:SRGGB8_1X8/1920x1080 field: none]}") the gstreamer works fine.
gstreamer pipeline is :

gst-launch-1.0 \
v4l2src device=/dev/video-imx219-cam1 io-mode=5 ! queue max-size-buffers=1 leaky=2 ! video/x-bayer,width=1920,height=1080,framerate=30/1,format=rggb ! \
tiovxisp sink_0::device=/dev/v4l-imx219-subdev1 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/linear/dcc_viss_1920x1080.bin \
sink_0::dcc-2a-file=/opt/imaging/imx219/linear/dcc_2a_1920x1080.bin format-msb=7 ! \
video/x-raw,format=NV12, width=1920,height=1080 ! queue ! mosaic.sink_0 \
tiovxmosaic name=mosaic \
sink_0::startx="<0>" sink_0::starty="<0>" sink_0::widths="<640>" sink_0::heights="<480>" ! \
queue ! video/x-raw, width=1920, height=1080 ! queue ! kmssink driver-name=tidss sync=false force-modesetting=true

I created bin files for the resolution 3264x2464 by imaging-main. Used config file is

SENSOR_ID 219
PRJ_DIR ../../../sensor_drv/src/imx219_output
SENSOR_NAME imx219
SENSOR_DCC_NAME IMX219

SENSOR_WIDTH  3264
SENSOR_HEIGHT 2464

# 0=RGGB; 1=GRBG; 2=GBRG; 3=BGGR, 4=MONO
COLOR_PATTERN 0

# sensor mode: 0 for linear (no decompanding), 1 for WDR (decompanding)
WDR_MODE 0

# raw sensor image BIT_DEPTH: it may be 8, 10, or 12 for linear sensors; typically 12 for WDR mode because of companding
BIT_DEPTH 10

# WDR BIT_DEPTH: WDR raw sensor image bitdepth after decompanding, typically 20 or 24
WDR_BIT_DEPTH 10

# WDR decompanding knee points (comma separated without spaces in between)
WDR_KNEE_X 0,512,1408,2176,4095,65535
WDR_KNEE_Y 0,2048,16384,65536,1048063,1048063

# Sensor black level to subtract before decompanding (for linear sensors only and some Sony WDR sensors)
BLACK_PRE  64

# Sensor black level to subtract after decompanding (for most WDR sensors and all linear sensors)
BLACK_POST  0

# GAMMA value for compressing 20/24-bit WDR raw to 16-bit ISP internal
# typically around 50 (0.5) for 24-bit WDR sensors and 70 (0.7) for 20-bit sensors
GAMMA_PRE 70

# LSB location for H3A input bit range (from bit-H3A_INPUT_LSB to bit-H3A_INPUT_LSB+9)
H3A_INPUT_LSB 0

# Choose the default gamma curve used for YUV output: 0 for BT709, 1 for a high contrast gamma curve
YUV_GAMMA 1

and copied that files to imaging/imx219/linear

# ls ../imaging/imx219/linear/dcc_*3264*
../imaging/imx219/linear/dcc_2a_3264x2464.bin  ../imaging/imx219/linear/dcc_viss_3264x2464.bin

Also changed the script/setup_cameras_v3link.sh and sourced

IMX219_CAM_FMT="${IMX219_CAM_FMT:-[fmt:SRGGB10_1X10/3264x2464 field: none]}"

terminal print when sourcing setup script is

root@am62axx-evm:/opt/edgeai-gst-apps# source scripts/setup_cameras_v3link.sh 
IMX219 Camera 0 detected
    device = /dev/video-imx219-cam0
    name = imx219
    format = [fmt:SRGGB10_1X10/3264x2464 field: none]
    subdev_id = /dev/v4l-imx219-subdev0
    isp_required = yes
    ldc_required = yes
IMX219 Camera 1 detected
    device = /dev/video-imx219-cam1
    name = imx219
    format = [fmt:SRGGB10_1X10/3264x2464 field: none]
    subdev_id = /dev/v4l-imx219-subdev1
    isp_required = yes
    ldc_required = yes

terminal print of error and runned pipeline is below

root@am62axx-evm:/opt/edgeai-gst-apps# gst-launch-1.0 \
> v4l2src device=/dev/video-imx219-cam1 io-mode=5 ! queue max-size-buffers=1 leaky=2 ! video/x-bayer,width=3264,height=2464,framerate=20/1,format=rggb10 ! \
> tiovxisp sink_0::device=/dev/v4l-imx219-subdev1 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/linear/dcc_viss_3264x2464.bin \
> sink_0::dcc-2a-file=/opt/imaging/imx219/linear/dcc_2a_3264x2464.bin format-msb=8 ! \
> video/x-raw,format=NV12, width=3264,height=2464 ! queue ! mosaic.sink_0 \
> tiovxmosaic name=mosaic \
> sink_0::startx="<0>" sink_0::starty="<0>" sink_0::widths="<640>" sink_0::heights="<480>" ! \
> queue ! video/x-raw, width=1920, height=1080 ! queue ! kmssink driver-name=tidss sync=false force-modesetting=true
APP: Init ... !!!
  5602.543668 s: MEM: Init ... !!!
  5602.543736 s: MEM: Initialized DMA HEAP (fd=8) !!!
  5602.543918 s: MEM: Init ... Done !!!
  5602.543938 s: IPC: Init ... !!!
  5602.561147 s: IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
  5602.570757 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
  5602.574496 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_ERROR
  5602.574543 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_WARNING
  5602.574561 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_INFO
  5602.576613 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-0 
  5602.576793 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-1 
  5602.576974 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-2 
  5602.577113 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-3 
  5602.577133 s:  VX_ZONE_INFO: [tivxInitLocal:126] Initialization Done !!!
  5602.577145 s:  VX_ZONE_INFO: Globally Disabled VX_ZONE_INFO
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Failed to allocate required memory.
Additional debug info:
/usr/src/debug/gstreamer1.0-plugins-good/1.22.12/sys/v4l2/gstv4l2src.c(950): gst_v4l2src_decide_allocation (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
Buffer pool activation failed
Execution ended after 0:00:00.018399415
Setting pipeline to NULL ...
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Internal data stream error.
Additional debug info:
/usr/src/debug/gstreamer1.0/1.22.12/libs/gst/base/gstbasesrc.c(3134): gst_base_src_loop (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
streaming stopped, reason not-negotiated (-4)

(gst-launch-1.0:1973): GStreamer-Video-CRITICAL **: 00:00:50.750: gst_video_info_from_caps: assertion 'caps != NULL' failed
ERROR: from element /GstPipeline:pipeline0/GstTIOVXISP:tiovxisp0: Unable to init TIOVX module
Additional debug info:
/usr/src/debug/edgeai-gst-plugins/1.0.0/gst-libs/gst/tiovx/gsttiovxmiso.c(1512): gst_tiovx_miso_negotiated_src_caps (): /GstPipeline:pipeline0/GstTIOVXISP:tiovxisp0
Freeing pipeline ...
  5602.778012 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff83797cf0 of type 00000817 at external count 1, internal count 0, releasing it
  5602.778058 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=raw_image_81) now as a part of garbage collection
  5602.778101 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8383ac10 of type 00000813 at external count 1, internal count 0, releasing it
  5602.778114 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_82) now as a part of garbage collection
  5602.779601 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8383adc0 of type 00000813 at external count 1, internal count 0, releasing it
  5602.779631 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_84) now as a part of garbage collection
  5602.780989 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8383af70 of type 00000813 at external count 1, internal count 0, releasing it
  5602.781016 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_86) now as a part of garbage collection
  5602.782343 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8383b120 of type 00000813 at external count 1, internal count 0, releasing it
  5602.782364 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_88) now as a part of garbage collection
  5602.783746 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8383b2d0 of type 00000813 at external count 1, internal count 0, releasing it
  5602.783774 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_90) now as a part of garbage collection
  5602.785126 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8383b480 of type 00000813 at external count 1, internal count 0, releasing it
  5602.785152 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_92) now as a part of garbage collection
APP: Deinit ... !!!
REMOTE_SERVICE: Deinit ... !!!
REMOTE_SERVICE: Deinit ... Done !!!
  5602.791689 s: IPC: Deinit ... !!!
  5602.792216 s: IPC: DeInit ... Done !!!
  5602.792260 s: MEM: Deinit ... !!!
  5602.792277 s: DDR_SHARED_MEM: Alloc's: 6 alloc's of 96509952 bytes 
  5602.792290 s: DDR_SHARED_MEM: Free's : 6 free's  of 96509952 bytes 
  5602.792299 s: DDR_SHARED_MEM: Open's : 0 allocs  of 0 bytes 
  5602.792314 s: MEM: Deinit ... Done !!!
APP: Deinit ... Done !!!

Please help me to fix the issue.

Regards,
Sajan

6 months ago

0 Sajan Saji 6 months ago

Intellectual 520 points

Hello,

By making bin files for 3280x2464. I got the output. But seems change in format. I mean the output seems grayscale or something like no RGB.
and also this seems low quality. 1 minute video only seems 2MB.

Pipeline I used is below.

gst-launch-1.0 -e \
v4l2src device=/dev/video-imx219-cam1 io-mode=5 ! \
video/x-bayer,width=3280,height=2464,framerate=15/1,format=rggb10 ! \
tiovxisp sink_0::device=/dev/v4l-imx219-subdev1 sensor-name=SENSOR_SONY_IMX219_RPI \
    dcc-isp-file=/opt/imaging/imx219/linear/dcc_viss_3280x2464_10b.bin \
    sink_0::dcc-2a-file=/opt/imaging/imx219/linear/dcc_2a_3280x2464_10b.bin format-msb=8 ! \
video/x-raw, format=NV12, width=3280, height=2464, framerate=20/1 ! \
tiovxmosaic name=mosaic \
sink_0::startx=0 sink_0::starty=0 sink_0::widths=3280 sink_0::heights=2464 ! \
video/x-raw, format=NV12, width=3280, height=2464, framerate=20/1 ! \
v4l2h264enc ! h264parse ! mp4mux ! \
filesink location=/opt/video.mp4

Warm Regards,
Sajan

0 Sajan Saji 6 months ago in reply to Sajan Saji

Intellectual 520 points

Hello,
One more thing. I tried 4k recording with 2 camera of frame rate 15. But seems errors

pipeline is

gst-launch-1.0 \
v4l2src device=/dev/video-imx219-cam0 io-mode=5 ! queue max-size-buffers=1 leaky=2 ! video/x-bayer,width=3280,height=2464,framerate=15/1,format=rggb10 ! \
tiovxisp sink_0::device=/dev/v4l-imx219-subdev0 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/linear/dcc_viss_3280x2464_10b.bin \
sink_0::dcc-2a-file=/opt/imaging/imx219/linear/dcc_2a_3280x2464_10b.bin format-msb=8 ! \
video/x-raw,format=NV12, width=3280,height=2464 ! queue ! mosaic.sink_0 \
v4l2src device=/dev/video-imx219-cam1 io-mode=5 ! queue max-size-buffers=1 leaky=2 ! video/x-bayer,width=3280,height=2464,framerate=15/1,format=rggb10 ! \
tiovxisp sink_0::device=/dev/v4l-imx219-subdev1 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/linear/dcc_viss_3280x2464_10b.bin \
sink_0::dcc-2a-file=/opt/imaging/imx219/linear/dcc_2a_3280x2464_10b.bin format-msb=8 ! \
video/x-raw,format=NV12, width=3280,height=2464 ! queue ! mosaic.sink_1 \
tiovxmosaic name=mosaic \
sink_0::startx="<0>" sink_0::starty="<0>" sink_0::widths="<640>" sink_0::heights="<480>" \
sink_1::startx="<0>" sink_1::starty="<480>" sink_1::widths="<640>" sink_1::heights="<480>" ! \
queue ! video/x-raw, width=1920, height=1080 ! queue ! kmssink driver-name=tidss sync=false force-modesetting=true

Error log

APP: Init ... !!!
 30709.296138 s: MEM: Init ... !!!
 30709.296196 s: MEM: Initialized DMA HEAP (fd=8) !!!
 30709.296342 s: MEM: Init ... Done !!!
 30709.296354 s: IPC: Init ... !!!
 30709.313874 s: IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
 30709.318282 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
 30709.318397 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_ERROR
 30709.318413 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_WARNING
 30709.318425 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_INFO
 30709.319332 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-0 
 30709.319618 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-1 
 30709.319882 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-2 
 30709.320120 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-3 
 30709.320156 s:  VX_ZONE_INFO: [tivxInitLocal:126] Initialization Done !!!
 30709.320170 s:  VX_ZONE_INFO: Globally Disabled VX_ZONE_INFO
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
 30709.478152 s: MEM: ERROR: Alloc failed with status = 12 !!!
 30709.478204 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src1: Failed to allocate required memory.
Additional debug info:
/usr/src/debug/gstreamer1.0-plugins-good/1.22.12/sys/v4l2/gstv4l2src.c(950): gst_v4l2src_decide_allocation (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src1:
Buffer pool activation failed
Execution ended after 0:00:00.009035095
Setting pipeline to NULL ...
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src1: Internal data stream error.
Additional debug info:
/usr/src/debug/gstreamer1.0/1.22.12/libs/gst/base/gstbasesrc.c(3134): gst_base_src_loop (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src1:
streaming stopped, reason not-negotiated (-4)
 30709.482227 s: MEM: ERROR: Alloc failed with status = 12 !!!
 30709.482288 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
 30709.482301 s:  VX_ZONE_ERROR: [ownAllocRawImageBuffer:359] could not allocate memory
 30709.482313 s:  VX_ZONE_ERROR: [ownGraphAllocateDataObject:1109] Memory allocation for replicated parameter parent object failed
 30709.482328 s:  VX_ZONE_ERROR: [ graph_107 ] Memory alloc for data objects failed
 30709.482339 s:  VX_ZONE_ERROR: [ graph_107 ] Graph verify failed
 30709.482834 s:  VX_ZONE_ERROR: [ownReleaseReferenceInt:747] Invalid reference
ERROR: from element /GstPipeline:pipeline0/GstTIOVXISP:tiovxisp1: Unable to init TIOVX module
Additional debug info:
/usr/src/debug/edgeai-gst-plugins/1.0.0/gst-libs/gst/tiovx/gsttiovxmiso.c(1512): gst_tiovx_miso_negotiated_src_caps (): /GstPipeline:pipeline0/GstTIOVXISP:tiovxisp1
Freeing pipeline ...
 30709.640231 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8975adc0 of type 00000813 at external count 1, internal count 0, releasing it
 30709.640272 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_84) now as a part of garbage collection
 30709.641680 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8975b120 of type 00000813 at external count 1, internal count 0, releasing it
 30709.641699 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_89) now as a part of garbage collection
 30709.643093 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8975b480 of type 00000813 at external count 1, internal count 0, releasing it
 30709.643117 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_93) now as a part of garbage collection
 30709.644441 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8975b7e0 of type 00000813 at external count 1, internal count 0, releasing it
 30709.644458 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_97) now as a part of garbage collection
 30709.645754 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8975bb40 of type 00000813 at external count 1, internal count 0, releasing it
 30709.645770 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_101) now as a part of garbage collection
 30709.647143 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff896aa970 of type 00000816 at external count 1, internal count 0, releasing it
 30709.647162 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=user_data_object_105) now as a part of garbage collection
 30709.647218 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff896aaba0 of type 00000816 at external count 1, internal count 0, releasing it
 30709.647232 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=user_data_object_106) now as a part of garbage collection
 30709.647280 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8975bea0 of type 00000813 at external count 1, internal count 0, releasing it
 30709.647293 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_108) now as a part of garbage collection
 30709.647313 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff896ab000 of type 00000816 at external count 1, internal count 0, releasing it
 30709.647326 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=user_data_object_109) now as a part of garbage collection
 30709.647344 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8975c050 of type 00000813 at external count 1, internal count 0, releasing it
 30709.647356 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_110) now as a part of garbage collection
 30709.647375 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff896b9ce0 of type 00000817 at external count 1, internal count 0, releasing it
 30709.647388 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=raw_image_111) now as a part of garbage collection
 30709.647406 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8975c200 of type 00000813 at external count 1, internal count 0, releasing it
 30709.647419 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_112) now as a part of garbage collection
 30709.647437 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff896ab230 of type 00000816 at external count 1, internal count 0, releasing it
 30709.647449 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=user_data_object_113) now as a part of garbage collection
 30709.647468 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff8975c3b0 of type 00000813 at external count 1, internal count 0, releasing it
 30709.647480 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_114) now as a part of garbage collection
 30709.979119 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffff896de340 of type 0000080f at external count 1, internal count 0, releasing it
 30709.979144 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=image_115) now as a part of garbage collection
APP: Deinit ... !!!
REMOTE_SERVICE: Deinit ... !!!
REMOTE_SERVICE: Deinit ... Done !!!
 30709.984488 s: IPC: Deinit ... !!!
 30709.984998 s: IPC: DeInit ... Done !!!
 30709.985037 s: MEM: Deinit ... !!!
 30709.985147 s: DDR_SHARED_MEM: Alloc's: 23 alloc's of 178199718 bytes 
 30709.985167 s: DDR_SHARED_MEM: Free's : 23 free's  of 178199718 bytes 
 30709.985177 s: DDR_SHARED_MEM: Open's : 0 allocs  of 0 bytes 
 30709.985193 s: MEM: Deinit ... Done !!!
APP: Deinit ... Done !!!

BR,
Sajan

0 Suren Porwar 6 months ago in reply to Sajan Saji

TI__Mastermind 31340 points

Hi Sajan

I am routing your query to our expert. Expect a response soon.

Best Regards,

Suren

0 Jianzhong Xu 6 months ago in reply to Suren Porwar

TI__Guru 60075 points

Hi Sajan,

Let's first make 1 camera work.

Sajan Saji said:
By making bin files for 3280x2464. I got the output. But seems change in format. I mean the output seems grayscale or something like no RGB.

Please try the attached DCC bins.

https://e2e.ti.com/cfs-file/__key/communityserver-discussions-components-files/791/7140.dcc_5F00_viss.bin

https://e2e.ti.com/cfs-file/__key/communityserver-discussions-components-files/791/7140.dcc_5F00_2a.bin

The following script of Gstreamer command works for me:

#!/bin/bash
gst-launch-1.0 v4l2src device=/dev/video-imx219-cam0 io-mode=dmabuf-import ! queue max-size-buffers=1 leaky=2 ! \
video/x-bayer, width=3280, height=2464, framerate=15/1, format=rggb10 ! \
tiovxisp sink_0::pool-size=4  sink_0::device=/dev/v4l-imx219-subdev0 sensor-name="SENSOR_SONY_IMX219_RPI" \
dcc-isp-file=$1/dcc_viss.bin \
sink_0::dcc-2a-file=$1/dcc_2a.bin format-msb=9 ! \
video/x-raw, format=NV12, width=3280, height=2464, framerate=15/1 ! queue ! tiovxmultiscaler ! queue ! \
video/x-raw, format=NV12, width=1920, height=1080, framerate=15/1 !  \
kmssink driver-name=tidss sync=false force-modesetting=true

Please note that IMX219 can only run for 15fps at this resolution.

There is a minor bug in the auto-exposure setting for this sensor. Please pick up this PR: https://github.com/TexasInstruments/edgeai-gst-plugins/pull/367 and rebuild the Gstreamer plugin according to the AM6xA ISP Tuning Guide, 5.4 Update GStreamer Plug-in for VISS.

Regards,

Jianzhong

0 Sajan Saji 6 months ago in reply to Jianzhong Xu

Intellectual 520 points

Hi Jianzhong,

If I try to rerun after stopping the pipeline. Seems a green blank screen in sink.

Here is the terminal print of error.

# gst-launch-1.0 v4l2src device=/dev/video-imx219-cam1 io-mode=dmabuf-import ! queue max-size-buffers=1 leaky=2 ! \
> video/x-bayer, width=3280, height=2464, framerate=15/1, format=rggb10 ! \
> tiovxisp sink_0::pool-size=4  sink_0::device=/dev/v4l-imx219-subdev1 sensor-name="SENSOR_SONY_IMX219_RPI" \
> dcc-isp-file=/opt/imaging/imx219/linear/dcc_viss_3280x2464_10b.bin \
> sink_0::dcc-2a-file=/opt/imaging/imx219/linear/dcc_2a_3280x2464_10b.bin format-msb=9 ! \
> video/x-raw, format=NV12, width=3280, height=2464, framerate=15/1 ! queue ! tiovxmultiscaler ! queue ! \
> video/x-raw, format=NV12, width=1920, height=1080, framerate=15/1 !  \
> kmssink driver-name=tidss sync=false force-modesetting=true 
APP: Init ... !!!
  1409.473895 s: MEM: Init ... !!!
  1409.473953 s: MEM: Initialized DMA HEAP (fd=8) !!!
  1409.474094 s: MEM: Init ... Done !!!
  1409.474107 s: IPC: Init ... !!!
  1409.491542 s: IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
  1409.496200 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
  1409.496323 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_ERROR
  1409.496335 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_WARNING
  1409.496347 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_INFO
  1409.497113 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-0 
  1409.497470 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-1 
  1409.497780 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-2 
  1409.498031 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-3 
  1409.498068 s:  VX_ZONE_INFO: [tivxInitLocal:126] Initialization Done !!!
  1409.498079 s:  VX_ZONE_INFO: Globally Disabled VX_ZONE_INFO
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
  1409.839306 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.839355 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.839567 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.839584 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.839709 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.839723 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.839843 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.839858 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.839994 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.840009 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.840126 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.840141 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.840309 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.840326 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.840470 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.840485 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.840614 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.840630 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.840763 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.840778 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.840909 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.840923 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.841042 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.841056 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.841185 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.841200 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.841313 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.841327 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.841441 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.841455 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.841577 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.841592 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.841710 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.841724 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.841847 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.841861 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.841975 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.841988 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.842118 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.842132 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.842256 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.842270 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.842381 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.842395 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.842518 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.842532 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.842657 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.842671 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.842787 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.842801 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.842921 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.842936 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1409.843049 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1409.843063 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.172892 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.172926 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.173074 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.173089 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.173234 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.173249 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.173385 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.173400 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.173519 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.173534 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.173651 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.173666 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.173796 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.173811 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.173927 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.173941 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.174067 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.174081 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.174197 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.174211 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.174325 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.174339 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.174502 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.174517 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.174632 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.174646 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.174774 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.174789 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.174902 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.174916 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.175032 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.175045 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.175172 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.175187 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.175300 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.175314 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.175425 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.175439 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.175563 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.175578 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.175696 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.175710 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.175852 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.175867 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.175985 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.176000 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.176113 s: MEM: ERROR: Alloc failed with status = 12 !!!
  1410.176127 s:  VX_ZONE_ERROR: [tivxMemBufferAlloc:111] Shared mem ptr allocation failed
  1410.176249 s: MEM: ERROR: Alloc failed with status = 12 !!!

Can you please give me the gui tool for tuning. I didn't see something like that anywhere. But the GUI is provided in ISP tuning guide.
Refered this ticket https://e2e.ti.com/support/processors-group/processors/f/processors-forum/1275034/faq-default-dcc-profile-generation-tool-for-tda4-am6xa-isp-vpac?tisearch=e2e-sitesearch&keymatch=%20user%3A35541

But vision_apps does not contains the single camera app.

# ls vision_apps/
app_c7x.cfg		    run_app_viss.sh			 vx_app_arm_ipc.out	    vx_app_c7x_kernel_1_img.txt		    vx_app_conformance.out	 vx_app_heap_stats.out
run_app_arm_fd_exchange.sh  vision_apps_init.sh			 vx_app_arm_mem.out	    vx_app_c7x_kernel_2_pipe_img.txt	    vx_app_conformance_core.out  vx_app_load_test.out
run_app_c7x.sh		    vx_app_arm_fd_exchange_consumer.out  vx_app_arm_remote_log.out  vx_app_c7x_kernel_3_data_ref_q_img.txt  vx_app_conformance_hwa.out	 vx_app_viss.out
run_app_load_test.sh	    vx_app_arm_fd_exchange_producer.out  vx_app_c7x_kernel.out	    vx_app_c7x_kernel_4_pipe0_img.txt	    vx_app_conformance_tidl.out

# ./vx_app_viss.out     
The number of args is 1
The arguments are (null) and SHELL=/bin/sh
Segmentation fault (core dumped)

BR,
Sajan

0 Jianzhong Xu 6 months ago in reply to Sajan Saji

TI__Guru 60075 points

Sajan Saji said:
If I try to rerun after stopping the pipeline. Seems a green blank screen in sink.

This is a different problem. Did you get images with correct color using the binaries I provided?

0 Sajan Saji 6 months ago in reply to Jianzhong Xu

Intellectual 520 points

Hello Jianzhong,

Previously I used the bin file I generated. Tried the bin file you provided. I used rggb10. Got the good color. But when I am checking with mediainfo of file seems bit depth as 8 bits. Tried the same thing by setting up 8 bit in script/setup_cameras_v3link.sh . But seems a very light exposed output. Can you please verify the bit depth, Is it 8 bit or 10 bit

Also I need to know about creation of bin file. Two days ago, I requested access for GUI DCC tuning tool. Can you please provide the configurations and values need to make the bin file. How did you created the bin viss and ldc bin files, using GUI or imaging-main.

Thanks,
Sajan

0 Jianzhong Xu 6 months ago in reply to Sajan Saji

TI__Guru 60075 points

Hello Sajan,

The bin files I provided to you are for 10-bit RGGB.

Sajan Saji said:
Two days ago, I requested access for GUI DCC tuning tool.

This tool requires NDA. Do you have a local TI contact person who can help you get an NDA in place?

Thanks,

Jianzhong

0 Sajan Saji 6 months ago in reply to Jianzhong Xu

Intellectual 520 points

Hello Jianzhong,

Jianzhong Xu said:
Do you have a local TI contact person who can help you get an NDA in place?

Yes. We already have the NDA in place with TI.

Prayag Sahoo, could you please involve and share the relevant data with Jianzhong?

Thanks,
Sajan

0 Jianzhong Xu 6 months ago in reply to Sajan Saji

TI__Guru 60075 points

Hi Sajan,

If you have an NDA, please request the ISP tuning tool from here: www.ti.com/.../ADAS-SW-IMAGING

Regards,

Jianzhong

0 Sajan Saji 6 months ago in reply to Jianzhong Xu

Intellectual 520 points

Hello Jianzhong,

Request is not accepted till.

Should I need to request one more.

Warm Regards,
Sajan

0 Jianzhong Xu 6 months ago in reply to Sajan Saji

TI__Guru 60075 points

Ok. Let me check.

0 Sajan Saji 6 months ago in reply to Jianzhong Xu

Intellectual 520 points

Hello Jianzhong,

Is there any version of linux compatible application for the same.

I am using linux environment

Best Regards,
Sajan

0 Jianzhong Xu 6 months ago in reply to Sajan Saji

TI__Guru 60075 points

Hi Sajan,

You should have received access to the tool.

Sajan Saji said:
Is there any version of linux compatible application for the same.

Unfortunately, we only have Windows based tool.

Regards,

Jianzhong

0 Sajan Saji 5 months ago in reply to Jianzhong Xu

Intellectual 520 points

Hello Jianzhong,

Can you please look into private chat that I created.
Having some error when opening the app.

Regards,
Sajan

0 Jianzhong Xu 5 months ago in reply to Sajan Saji

TI__Guru 60075 points

Hi Sajan,

The tool is under NDA, but you can post questions in the public forum. For your specific question, did you install the dependencies listed in the release notes of the tool:

ATTENTION: To complete the installation of the DCC Tuning Tool, please install the following dependencies:

MATLAB Compiler Runtime version 9.0 (64-bit) [LINK]
Microsoft Visual C++ 2010 Redistributable Package (x64) [LINK]
Visual C++ Redistributable for Visual Studio 2012 Update 4 (x64) [LINK]

Regards,

Jianzhong

0 Sajan Saji 5 months ago in reply to Jianzhong Xu

Intellectual 520 points

Hello Jianzhong,

Did these 3 dependencies successfully installed. But the same error occured.

Tried By changing the MATLAB version. And after tried to install DCCSetuptool 3.10. It also throws the same error.

Regards,
Sajan

0 Jianzhong Xu 5 months ago in reply to Sajan Saji

TI__Guru 60075 points

Sajan,

Let me loop in the tool's developer for further help. Are you using Windows 11?

Thanks,

Jianzhong

0 Sajan Saji 5 months ago in reply to Jianzhong Xu

Intellectual 520 points

Hello Jianzhong,

Jianzhong Xu said:
Windows 11

Yes, I am using windows 11

Thanks,
Sajan

0 Chau Le 5 months ago in reply to Sajan Saji

TI__Intellectual 1080 points

Hi Sajan,

This error indicates that MATLAB Compiler Runtime has not been installed. Can you verify if MCR has been installed properly?

Can you also try to install the latest version of the DCC Tuning Tool V3.2 and see if the issue persists? I have verified this on my Windows 11 setup and did not encounter any issues.

Best,

Chau

0 Sajan Saji 5 months ago in reply to Chau Le

Intellectual 520 points

Hi Chau,

Chau Le said:
Can you verify if MCR has been installed properly?

Yes, MCR is installed properly.

Chau Le said:
Can you also try to install the latest version of the DCC Tuning Tool V3.2 and see if the issue persists?

First I tried 3.20, then I tried to run 3.10. Unfortunately seems that, too throw the same error.

Tried changing MATLAB Compiler runtime versions also.

Warm Regards,
Sajan

0 Sajan Saji 5 months ago in reply to Chau Le

Intellectual 520 points

Also did the installation from scratch But same error persist ( code execution cannot proceed because mclmcrrt9_0.dll was not found ).
Is there any order of installation. I am installed in an order of MATLAB, Visual C++ dependencies and DCCSetup.exe at last

Regards,
Sajan

0 Sajan Saji 5 months ago in reply to Sajan Saji

Intellectual 520 points

Hello Chau,

Can you please help me on the above problem.

Warm Regards,
Sajan

0 Chau Le 5 months ago in reply to Sajan Saji

TI__Intellectual 1080 points

Hi Sajan,

Sajan Saji said:
Tried changing MATLAB Compiler runtime versions also

You may be encountering this issue due to multiple installed versions of MATLAB Runtime.

To resolve this, please uninstall all existing MATLAB Runtime versions from your system. Then, reinstall only MATLAB Compiler Runtime version 9.0 (64-bit) [LINK]. Once installation is complete, restart your laptop to ensure all changes take effect.

Best,

Chau

0 Sajan Saji 5 months ago in reply to Chau Le

Intellectual 520 points

Hello Chau,

Now it worked. Thanks for your help.

Also I had a doubt about new project creation file -> New Project gives a prompt to open the files.

In the guide seems the below step:

Warm Regards,
Sajan

0 Sajan Saji 5 months ago in reply to Sajan Saji

Intellectual 520 points

Hello Chau,

For your information I created a ticket parallely about my doubts.

e2e.ti.com/.../sk-am62a-lp-dcc-tuning-tool-related-query

Warm Regards,
Sajan

Processors

Processors forum

PROCESSOR-SDK-AM62A: Error in adding 4k video stream by adding bin files