• State
  • Locked Locked
  • Replies 24 replies
  • Subscribers 100 subscribers
  • Views 667 views
  • Users 0 members are here
Support feedback
Options
Options
Related

This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

SK-AM62A-LP: Using OV9284 sensor, the customized model cannot be run.

daohong qin
Expert 1120 points
Part Number: SK-AM62A-LP


Hi Jianzhong,

 

We have a customized model that can run when using the IMX219 sensor, but cannot run the model using the ov9284 sensor.

It is normal to only use the ov9284 sensor to display images.

media-ctl --set-v4l2 '"ov9284 4-0010":0 [fmt:Y10_1X10/1280x800]'

gst-launch-1.0 -v v4l2src device=/dev/video3 io-mode=dmabuf-import ! video/x-bayer, width=1280, height=800, framerate=30/1, format=bggr10 ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name="SENSOR_OV9284_RPI" dcc-isp-file=/opt/imaging/ov9284/linear/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging/ov9284/linear/dcc_2a.bin format-msb=9 ! video/x-raw, format=NV12, width=1280, height=800, framerate=30/1 ! kmssink driver-name=tidss

  

When I want to run a customized model using the ov9284 sensor, an error occurs.

./apps_python/app_edgeai.py configs/object_detection.yaml

object_detection.yaml

title: "Object Detection"
log_level: 2
inputs:
    input0:
        source: /dev/video3
        format: Y10
        width: 1280
        height: 800
        framerate: 30
    input1:
        source: /opt/edgeai-test-data/videos/video0_1280_768.h264
        format: h264
        width: 1280
        height: 768
        framerate: 30
        loop: True
    input2:
        source: /opt/edgeai-test-data/images/%04d.jpg
        width: 1280
        height: 720
        index: 0
        framerate: 1
        loop: True
models:
    model0:
        model_path: /opt/model_zoo/od-8200-12.01
        viz_threshold: 0.6
    model1:
        model_path: /opt/model_zoo/TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320
        viz_threshold: 0.6
    model2:
        model_path: /opt/model_zoo/ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416
        viz_threshold: 0.6
outputs:
    output0:
        sink: kmssink
        width: 1920
        height: 1080
        overlay-perf-type: graph
    output1:
        sink: /opt/edgeai-test-data/output/output_video0.mkv
        width: 1920
        height: 1080
    output2:
        sink: /opt/edgeai-test-data/output/output_image_%04d.jpg
        width: 1920
        height: 1080
    output3:
        sink: remote
        width: 1920
        height: 1080
        port: 8081
        host: 127.0.0.1
        encoding: jpeg
        overlay-perf-type: graph

flows:
    flow0: [input0,model0,output0,[320,150,1280,720]]

error logs:

root@am62axx-evm:/opt/edgeai-gst-apps# ./apps_python/app_edgeai.py configs/object_detection.yaml                                                                                                    libtidl_onnxrt_EP loaded 0x288bc270
Final number of subgraphs created are : 1, - Offloaded Nodes - 257, Total Nodes - 257
APP: Init ... !!!
MEM: Init ... !!!
MEM: Initialized DMA HEAP (fd=5) !!!
MEM: Init ... Done !!!
IPC: Init ... !!!
IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
  1831.089776 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
  1831.089937 s:  VX_ZONE_INIT:Enabled
  1831.089962 s:  VX_ZONE_ERROR:Enabled
  1831.089971 s:  VX_ZONE_WARNING:Enabled
  1831.091892 s:  VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
  1831.092476 s:  VX_ZONE_INIT:[tivxHostInitLocal:101] Initialization Done for HOST !!!
[ 1620.197057] ov9284 4-0010: sensor is actiove
[ 1620.218179] ov9284 4-0010: Received vblank 1022, new lpfr 1822
[ 1620.224198] ov9284 4-0010: success to start streaming
[ 1620.229266] ov9284 4-0010: sensor start stream success.
[ 1620.234532] cdns-csi2rx 30101000.csi-bridge: ov9284 success to start streams 0x1 on subdev
[ 1620.242811] j721e-csi2rx 30102000.ticsi2rx: ov9284 v4l2_subdev_enable_streams success
[ 1620.250659] j721e-csi2rx 30102000.ticsi2rx: ov9284 check ti_csi2rx_start_streaming finish
[ 1620.259065] ov9284 4-0010: ov9284 set stream unable
==========[INPUT PIPELINE(S)]==========

[ 1620.675842] ov9284 4-0010: sensor is actiove
[PIPE-0]

v4l2src device=/dev/video3 pixel-aspect-ratio=None ! capsfilter caps="video/x-raw, width=(int)1280, height=(int)800;" ! tiovxdlcolorconvert ! capsfilter caps="video/x-raw, format=(string)NV1[ 1620.697268] ov9284 4-0010: Received vblank 1022, new lpfr 1822
2;" ! tiovxmultiscaler name=split_01
split_01. ! queue ! capsfi[ 1620.704420] ov9284 4-0010: success to start streaming
lter caps="video/x-raw, width=(int)1280, height=(int)720;" ! tio[ 1620.714879] ov9284 4-0010: sensor start stream success.
vxdlcolorconvert out-pool-size=4 ! capsfilter caps="video/x-raw,[ 1620.725644] cdns-csi2rx 30101000.csi-bridge: ov9284 success to start streams 0x1 on subdev
 format=(string)RGB;" ! appsink max-buffers=2 drop=True name=sen[ 1620.739442] j721e-csi2rx 30102000.ticsi2rx: ov9284 v4l2_subdev_enable_streams success
_0
split_01. ! queue ! capsfilter caps="video/x-raw, width=(int[ 1620.752811] j721e-csi2rx 30102000.ticsi2rx: ov9284 check ti_csi2rx_start_streaming finish
)416, height=(int)416;" ! tiovxdlpreproc out-pool-size=4 data-type=3 tensor-format=1 ! capsfilter caps="application/x-tensor-tiovx;" ! appsink max-buffers=2 drop=True name=pre_0


==========[OUTPUT PIPELINE]==========

appsrc do-timestamp=True format=3 block=True name=post_0 ! tiovxdlcolorconvert ! capsfilter caps="video/x-raw, format=(string)NV12, width=(int)1280, height=(int)720;" ! queue ! mosaic_0.sink_0

tiovxmosaic target=1 background=/tmp/background_0 name=mosaic_0 src::pool-size=4
sink_0::startx="<320>" sink_0::starty="<150>" sink_0::widths="<1280>" sink_0::heights="<720>"
! capsfilter caps="video/x-raw, format=(string)NV12, width=(int)1920, height=(int)1080;" ! queue ! tiperfoverlay title=Object Detection ! kmssink sync=False max-lateness=5000000 qos=True processing-deadline=15000000 driver-name=tidss connector-id=40 plane-id=31 force-modesetting=True

 +--------------------------------------------------------------------------+
 | Object Detection                                                         |
 +--------------------------------------------------------------------------+
 +--------------------------------------------------------------------------+
 | Input Src: /dev/video3                                                   |
 | Model Name: od-8200-12.01                                                |
 | Model Type: detection                                                    |
 +--------------------------------------------------------------------------+
 +--------------------------------------------------------------------------+

 +--------------------------------------------------------------------------+
 | Object Detection                                                         |
 +--------------------------------------------------------------------------+
 +--------------------------------------------------------------------------+
 | Input Src: /dev/video3                                                   |
 | Model Name: od-8200-12.01                                                |
 | Model Type: detection                                                    |
 +--------------------------------------------------------------------------+
 +--------------------------------------------------------------------------+

 +--------------------------------------------------------------------------+
 | Object Detection                                                         |
 +--------------------------------------------------------------------------+
 +--------------------------------------------------------------------------+
 | Input Src: /dev/video3                                                   |
 | Model Name: od-8200-12.01                                                |
 | Model Type: detection                                                    |
 +--------------------------------------------------------------------------+
 +--------------------------------------------------------------------------+

 +--------------------------------------------------------------------------+
 | Object Detection                                                         |
 +--------------------------------------------------------------------------+
 +--------------------------------------------------------------------------+
 | Input Src: /dev/video3                                                   |
 | Model Name: od-8200-12.01                                                |
 | Model Type: detection                                                    |
 +--------------------------------------------------------------------------+
 +--------------------------------------------------------------------------+

 +--------------------------------------------------------------------------+
 | Object Detection                                                         |
 +--------------------------------------------------------------------------+
 +--------------------------------------------------------------------------+
 | Input Src: /dev/video3                                                   |
 | Model Name: od-8200-12.01                                                |
 | Model Type: detection                                                    |
 +--------------------------------------------------------------------------+
 +--------------------------------------------------------------------------+[ERROR] Error pulling tensor from GST Pipeline
                                                                                                                           [ 1625.880660] ov9284 4-0010: ov9284 set stream unable

 +--------------------------------------------------------------------------+
 | Object Detection                                                         |
 +--------------------------------------------------------------------------+
 +--------------------------------------------------------------------------+
 | Input Src: /dev/video3                                                   |
 | Model Name: od-8200-12.01                                                |
 | Model Type: detection                                                    |
 +--------------------------------------------------------------------------+
 +--------------------------------------------------------------------------+
  1838.282019 s:  VX_ZONE_INIT:[tivxHostDeInitLocal:115] De-Initialization Done for HOST !!!
  1838.286983 s:  VX_ZONE_INIT:[tivxDeInitLocal:193] De-Initialization Done !!!
APP: Deinit ... !!!
REMOTE_SERVICE: Deinit ... !!!
REMOTE_SERVICE: Deinit ... Done !!!
IPC: Deinit ... !!!
IPC: DeInit ... Done !!!
MEM: Deinit ... !!!
DDR_SHARED_MEM: Alloc's: 51 alloc's of 86277732 bytes
DDR_SHARED_MEM: Free's : 51 free's  of 86277732 bytes
DDR_SHARED_MEM: Open's : 0 allocs  of 0 bytes
MEM: Deinit ... Done !!!
APP: Deinit ... Done !!!
root@am62axx-evm:/opt/edgeai-gst-apps#

 

Best Regards,

Ruihua

  • 0
    TI__Guru 60255 points

    Hello Ruihua,

    Can you provide the complete GStreamer pipeline generated by the script?

    Thanks,

    Jianzhong

  • 0 in reply to Jianzhong Xu
    Expert 1120 points

    Hi Jianzhong,

      

    root@am62axx-evm:/opt/edgeai-gst-apps# media-ctl -p | grep -i ov9284
                <- "ov9284 4-0010":0 [ENABLED,IMMUTABLE]
- entity 15: ov9284 4-0010 (1 pad, 1 link, 0 route)


root@am62axx-evm:/opt/edgeai-gst-apps# media-ctl -p
Media controller API version 6.1.46

Media device information
------------------------
driver          j721e-csi2rx
model           TI-CSI2RX
serial
bus info        platform:30102000.ticsi2rx
hw revision     0x1
driver version  6.1.46

Device topology
- entity 1: 30102000.ticsi2rx (7 pads, 7 links, 0 route)
            type V4L2 subdev subtype Unknown flags 0
            device node name /dev/v4l-subdev0
        pad0: Sink
                [stream:0 fmt:Y10_1X10/1280x800 field:none colorspace:raw xfer:none]
                <- "cdns_csi2rx.30101000.csi-bridge":1 [ENABLED,IMMUTABLE]
        pad1: Source
                -> "30102000.ticsi2rx context 0":0 [ENABLED,IMMUTABLE]
        pad2: Source
                -> "30102000.ticsi2rx context 1":0 [ENABLED,IMMUTABLE]
        pad3: Source
                -> "30102000.ticsi2rx context 2":0 [ENABLED,IMMUTABLE]
        pad4: Source
                -> "30102000.ticsi2rx context 3":0 [ENABLED,IMMUTABLE]
        pad5: Source
                -> "30102000.ticsi2rx context 4":0 [ENABLED,IMMUTABLE]
        pad6: Source
                -> "30102000.ticsi2rx context 5":0 [ENABLED,IMMUTABLE]

- entity 9: cdns_csi2rx.30101000.csi-bridge (5 pads, 2 links, 1 route)
            type V4L2 subdev subtype Unknown flags 0
            device node name /dev/v4l-subdev1
        routes:
                0/0 -> 1/0 [ACTIVE]
        pad0: Sink
                [stream:0 fmt:Y10_1X10/1280x800 field:none colorspace:raw xfer:none]
                <- "ov9284 4-0010":0 [ENABLED,IMMUTABLE]
        pad1: Source
                [stream:0 fmt:Y10_1X10/1280x800 field:none colorspace:raw xfer:none]
                -> "30102000.ticsi2rx":0 [ENABLED,IMMUTABLE]
        pad2: Source
        pad3: Source
        pad4: Source

- entity 15: ov9284 4-0010 (1 pad, 1 link, 0 route)
             type V4L2 subdev subtype Sensor flags 0
             device node name /dev/v4l-subdev2
        pad0: Source
                [stream:0 fmt:Y10_1X10/1280x800 field:none colorspace:raw xfer:none]
                -> "cdns_csi2rx.30101000.csi-bridge":0 [ENABLED,IMMUTABLE]

- entity 21: 30102000.ticsi2rx context 0 (1 pad, 1 link, 0 route)
             type Node subtype V4L flags 0
             device node name /dev/video3
        pad0: Sink
                <- "30102000.ticsi2rx":1 [ENABLED,IMMUTABLE]

- entity 27: 30102000.ticsi2rx context 1 (1 pad, 1 link, 0 route)
             type Node subtype V4L flags 0
             device node name /dev/video4
        pad0: Sink
                <- "30102000.ticsi2rx":2 [ENABLED,IMMUTABLE]

- entity 33: 30102000.ticsi2rx context 2 (1 pad, 1 link, 0 route)
             type Node subtype V4L flags 0
             device node name /dev/video5
        pad0: Sink
                <- "30102000.ticsi2rx":3 [ENABLED,IMMUTABLE]

- entity 39: 30102000.ticsi2rx context 3 (1 pad, 1 link, 0 route)
             type Node subtype V4L flags 0
             device node name /dev/video6
        pad0: Sink
                <- "30102000.ticsi2rx":4 [ENABLED,IMMUTABLE]

- entity 45: 30102000.ticsi2rx context 4 (1 pad, 1 link, 0 route)
             type Node subtype V4L flags 0
             device node name /dev/video7
        pad0: Sink
                <- "30102000.ticsi2rx":5 [ENABLED,IMMUTABLE]

- entity 51: 30102000.ticsi2rx context 5 (1 pad, 1 link, 0 route)
             type Node subtype V4L flags 0
             device node name /dev/video8
        pad0: Sink
                <- "30102000.ticsi2rx":6 [ENABLED,IMMUTABLE]

    Best Regards,

    Ruihua

  • 0 in reply to daohong qin
    TI__Guru 60255 points

    Hi Ruihua,

    The media entities look good. I suspect the GStreamer pipeline generated by the Python script has issues with working with Y10 format. For example, tiovxdlcolorconvert doesn't support Y10: https://github.com/TexasInstruments/edgeai-gst-plugins/wiki/tiovxdlcolorconvert.

    Regards,

    Jianzhong

  • 0 in reply to Jianzhong Xu
    Expert 1120 points

    Hi Jianzhong,

    Can your team try to make it compatible with Y10?

    Best Regards,

    Ruihua

  • 0 in reply to daohong qin
    TI__Guru 60255 points

    Hello Ruihua,

    Are you using the ISP (VPAC) in your gst pipeline? The ISP should be able to generate output with YUV format.

    Can you share the complete gst pipeline that was generated by the Python script?

    Thanks,

    Jianzhong

  • 0 in reply to Jianzhong Xu
    Expert 1120 points

    Hi Jianzhong

      

    Using camera command:

    media-ctl --set-v4l2 '"ov9284 4-0010":0 [fmt:Y10_1X10/1280x800]'

gst-launch-1.0 -v v4l2src device=/dev/video3 io-mode=dmabuf-import ! \
video/x-bayer, width=1280, height=800, framerate=30/1, format=bggr10 ! \
tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name="SENSOR_OV9284_RPI" \
dcc-isp-file=/opt/imaging/ov9284/linear/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging/ov9284/linear/dcc_2a.bin format-msb=9 ! \
video/x-raw, format=NV12, width=1280, height=800, framerate=30/1 ! kmssink driver-name=tidss

    ov9284_properties.txt

    SENSOR_ID 9284
PRJ_DIR ../ov9284_output
SENSOR_NAME ov9284
SENSOR_DCC_NAME ov9284

SENSOR_WIDTH 1280
SENSOR_HEIGHT 800

# 0=RGGB; 1=GRBG; 2=GBRG; 3=BGGR, 4=MONO
COLOR_PATTERN 0

# sensor mode: 0 for linear (no decompanding), 1 for WDR (decompanding)
WDR_MODE 0

# raw sensor image BIT_DEPTH: it may be 8, 10, or 12 for linear sensors; typically 12 for WDR mode because of companding
BIT_DEPTH 10

# WDR BIT_DEPTH: WDR raw sensor image bitdepth after decompanding, typically 20 or 24
WDR_BIT_DEPTH 20

# WDR decompanding knee points (comma separated without spaces in between)
WDR_KNEE_X 0,512,1408,2176,4095,65535
WDR_KNEE_Y 0,2048,16384,65536,1048063,1048063

# Sensor black level to subtract before decompanding (for linear sensors only and some Sony WDR sensors)
BLACK_PRE  0

# Sensor black level to subtract after decompanding (for most WDR sensors and all linear sensors)
BLACK_POST  0

# GAMMA value for compressing 20/24-bit WDR raw to 16-bit ISP internal
# typically around 50 (0.5) for 24-bit WDR sensors and 70 (0.7) for 20-bit sensors
GAMMA_PRE 50

# LSB location for H3A input bit range (from bit-H3A_INPUT_LSB to bit-H3A_INPUT_LSB+9) 
H3A_INPUT_LSB 0

      

    dcc_bins.zip

     

    Best Regards,

    Ruihua

  • 0 in reply to daohong qin
    TI__Guru 60255 points

    Hi Ruihua,

    We're on holiday break. I'll get back to you early January.

    Thanks for your patience.

    Regards,

    Jianzhong

  • 0 in reply to Jianzhong Xu
    TI__Guru 60255 points

    Hello Ruihua,

    I'm back from the holiday break. What's your current status?

    Thanks,

    Jianzhong

  • 0 in reply to Jianzhong Xu
    Expert 1120 points

    Hi Jianzhong,

     

    The current status has not changed and is still as described before.

     

    I am facing a new technical requirement, which requires integrating a third-party DMS algorithm and embedding it into the GStreamer plug-in pipeline in the form of an so file. I checked the source code and guessed that the algorithm processing logic needs to be embedded in gsttidlinferer.cpp. Is this right?

    Best Regards,

    Ruihua

  • 0 in reply to daohong qin
    TI__Guru 60255 points

    Hi Ruihua,

    Can you remove the debugging info and provide the gst pipeline when running "./apps_python/app_edgeai.py configs/object_detection.yaml"?

    For your question about integrating the DMS algorithm, please open a new thread.

    Thanks,

    Jianzhong

  • 0 in reply to Jianzhong Xu
    Expert 1120 points

    Hi Jianzhong,

    <Inline code snippet removed> - Admin 

    Thanks,

    Ruihua

  • 0 in reply to daohong qin
    TI__Expert 8560 points

    Hi Ruihua -

    There was an issue with your embedded code snippet in the above reply that caused this web page to fail to load. I have edited the reply to remove the code snippet. You can add this as a file attachment rather than directly inline. Sorry for any inconvenience!

    John

  • 0 in reply to John Walker
    Expert 1120 points

    Hi Jianzhong,

     

    Fullscreen 8713.error.txt Download 
    root@am62axx-evm:/opt/edgeai-gst-apps# ./apps_python/app_edgeai.py configs/object_detection.yaml
libtidl_onnxrt_EP loaded 0x1359fe20
Final number of subgraphs created are : 1, - Offloaded Nodes - 257, Total Nodes - 257
APP: Init ... !!!
MEM: Init ... !!!
MEM: Initialized DMA HEAP (fd=5) !!!
MEM: Init ... Done !!!
IPC: Init ... !!!
IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
  4325.861266 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
  4325.861404 s:  VX_ZONE_INIT:Enabled
  4325.861432 s:  VX_ZONE_ERROR:Enabled
  4325.861443 s:  VX_ZONE_WARNING:Enabled
  4325.862868 s:  VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
  4325.863134 s:  VX_ZONE_INIT:[tivxHostInitLocal:101] Initialization Done for HOST !!!
==========[INPUT PIPELINE(S)]==========

[PIPE-0]

v4l2src device=/dev/video3 pixel-aspect-ratio=None ! capsfilter caps="video/x-raw, width=(int)1280, height=(int)800;" ! videoconvert qos=True ! capsfilter caps="video/x-raw, format=(string)NV12;" ! tiovxmultiscaler name=split_01
split_01. ! queue ! capsfilter caps="video/x-raw, width=(int)1280, height=(int)720;" ! videoconvert qos=True ! capsfilter caps="video/x-raw, format=(string)RGB;" ! appsink max-buffers=2 drop=True name=sen_0
split_01. ! queue ! capsfilter caps="video/x-raw, width=(int)416, height=(int)416;" ! tiovxdlpreproc out-pool-size=4 data-type=3 tensor-format=1 ! capsfilter caps="application/x-tensor-tiovx;" ! appsink max-buffers=2 drop=True name=pre_0


==========[OUTPUT PIPELINE]==========

appsrc do-timestamp=True format=3 block=True name=post_0 ! tiovxdlcolorconvert ! capsfilter caps="video/x-raw, format=(string)NV12, width=(int)1280, height=(int)720;" ! queue ! mosaic_0.sink_0

tiovxmosaic target=1 background=/tmp/background_0 name=mosaic_0 src::pool-size=4
sink_0::startx="<320>" sink_0::starty="<150>" sink_0::widths="<1280>" sink_0::heights="<720>"
! capsfilter caps="video/x-raw, format=(string)NV12, width=(int)1920, height=(int)1080;" ! queue ! tiperfoverlay title=Object Detection ! kmssink sync=False max-lateness=5000000 qos=True processing-deadline=15000000 driver-name=tidss connector-id=40 plane-id=31 force-modesetting=True

  4332.865464 s:  VX_ZONE_INIT:[tivxHostDeInitLocal:115] De-Initialization Done for HOST !!!
  4332.870468 s:  VX_ZONE_INIT:[tivxDeInitLocal:193] De-Initialization Done !!!
APP: Deinit ... !!!
REMOTE_SERVICE: Deinit ... !!!
REMOTE_SERVICE: Deinit ... Done !!!
IPC: Deinit ... !!!
IPC: DeInit ... Done !!!
MEM: Deinit ... !!!
DDR_SHARED_MEM: Alloc's: 41 alloc's of 67487188 bytes
DDR_SHARED_MEM: Free's : 41 free's  of 67487188 bytes
DDR_SHARED_MEM: Open's : 0 allocs  of 0 bytes
MEM: Deinit ... Done !!!
APP: Deinit ... Done !!!

     

     

    Thanks,

    Ruihua

  • 0 in reply to daohong qin
    TI__Guru 60255 points

    Hi Ruihua,

    Thanks for providing the gst pipeline. I didn't find ISP in the pipeline. If you use ISP like you did when just streaming ov9284 sensor to the display, image will be converted to NV12 and tiovxdlcolorconvert should work.

    I'll try this application using a RAW10 sensor next week. Meanwhile, please try on your side to bring the ISP into the pipeline, similar to IMX219.

    Regards,

    Jianzhong

  • 0 in reply to Jianzhong Xu
    Expert 1120 points

    Hi Jianzhong,

     

    Use this command: ./apps_python/app_edgeai.py configs/object_detection.yaml, I don't know how to use ISP yet

     

    Thanks,

    Ruihua

  • 0 in reply to daohong qin
    TI__Guru 60255 points

    Hi Ruihua,

    You'll need to add OV9284 to gst_wrapper.get_input_elements():

    github.com/.../gst_wrapper.py

    You follow IMX219 as an example.

    Regards,

    Jianzhong

  • 0 in reply to Jianzhong Xu
    Expert 1120 points

    Hi Jianzhong,

      

    I added ov9284 in /opt/edgeai-gst-apps/apps_python/gst_wrapper.py

    Error when running python script: UnboundLocalError: local variable 'sen_name' referenced before assignment

    I have used the sensor normally and displayed the image on the display screen,

    the locale should be able to support sen_name = "SENSOR_OV9284_RPI".

    for example：

    /opt/edgeai-tiovx-modules/src/tiovx_sensor_module.c

     

    /opt/edgeai-gst-plugins/ext/tiovx/gsttiovxisp.c

     

    Regarding the error report of sen_name, is there anything else I missed?

     

    Thanks,

    Ruihua

  • 0 in reply to daohong qin
    TI__Guru 60255 points

    What's the input.sen_id on line 700? Can you add a print to show it? I suspect the "sen_id" wasn't set to ov9284.

    Your changes to tiovx_sensor_module.c and gsttiovxisp.c look good. You already validated that by running a gstreamer pipeline using ISP for ov9284.

  • 0 in reply to Jianzhong Xu
    Expert 1120 points

    Hi Jianzhong,

     

    Here sen_id sen_name has been set to ov9284.But there are still bugs.

     

    Thanks,

    Ruihua

  • 0 in reply to daohong qin
    Expert 1120 points

    Hi Jianzhong，

     

    any update?

     

    Thanks,

    Ruihua

  • 0 in reply to daohong qin
    TI__Guru 60255 points

    Hello Ruihua,

    Sorry for my late response. I'm not very familiar with that script. We have another team member who is familiar with it but he is currently out. Please give us a few days.

    Regards,

    Jianzhong

  • 0 in reply to Jianzhong Xu
    TI__Genius 16996 points

    Hi Ruihua,

    I see you are using the python scripts to generate and run the pipeline, and that you are making some changes to gstreamer plugins' C code to enable this new sensor.

    Are you recompiling and reinstalling these gstreamer plugins after your changes? Your changes to the C code may not have been implemented in the installed plugins. There is a script in edgeai-gst-apps/scripts/install_gst_plugins.sh that can do this for you. Please try recompiling and rerun the python application.

    Best,
    Reese

  • 0 in reply to Reese Grimsley
    Expert 1120 points

    Hi Reese,

     

    I have recompiled. The issue I asked occurred after recompiling.

    Thanks,

    Ruihua

  • 0 in reply to daohong qin
    TI__Genius 16996 points

    Hi Ruihua,

    I cannot tell what the issue is from the available logs, then (assuming there is no change after recompile). Could you prepend to your call to the python script the string "GST_DEBUG=2"? This gives WARNING level messages. Use 4 for INFO level, which is much more verbose. Debug levels documented here.

    I am curious if it throws the same error for another sensor like IMX219, although I understand if one is not available to perform this test.

    -Reese