SK-TDA4VM: enable arducam ptz camera on sk-tda4vm

Hi Mariem,

Could you clarify whichArducam model ptz camera you are looking to enable? We have not tested or validated any ptz camera with our devices so this would not be supported out of box. For a list of sensors that are supported on SK-TDA4VM, reference the following: https://software-dl.ti.com/jacinto7/esd/processor-sdk-linux-sk-tda4vm/10_00_00/exports/edgeai-docs/devices/TDA4VM/linux/getting_started.html#hardware-setup

Thank you,

Fabiana

Hello Fabiana,

Thank you for your answer. I am using the camera PTZ Arducam 8 MP (here is the link: https://www.arducam.com/product/b01678mp-arducam-8mp-pan-tilt-zoom-ptz-camera-for-raspberry-pi/ ) 

Isn't possible to integrate it and use it for a custom model that I am implementing. It is a model that detects the person's face and then keep tracking it. 

If this is possible, could you please suggest me the right approach to follow?

Thanks a lot,

Mariem

Hi Mariem,

The sensor linked is based on the 8MP IMX219 sensor which is supported on this device. The instructions to enable this sensor are outlined here: https://software-dl.ti.com/jacinto7/esd/processor-sdk-linux-sk-tda4vm/10_00_00/exports/edgeai-docs/devices/TDA4VM/linux/getting_started.html#rpiv2-imx219-raw-sensor

Once you have made the required changes, you should see the sensor information by either rebooting the device, running ./init_script.sh or ./scripts/setup_cameras.sh as seen here: https://software-dl.ti.com/jacinto7/esd/processor-sdk-linux-sk-tda4vm/10_00_00/exports/edgeai-docs/common/configuration_file.html#camera-sources-v4l2

Use the sensor information provided as the input source in your custom model. Take a look through the demos and tutorials in SDK documentation to understand how this can be accomplished. Let me know if you have any further questions.

Thank you,

Fabiana

Hello Fabiana,

Thank you very much :) I successfully connected the camera, I can see the sensor information when launching the script: setup_cameras.sh.

However, when I tried to test it, I had some errors.

On target side I run successfully the ros node: 

ros2 launch gscam2 v4l_imx219_launch.py cam_id:=X subdev_id:=Y

But from the PC side I cannot visualize the camera's output. I used the following command:

ros2 launch ti_viz_nodes gscam_nv12_launch.py width:=1280 height:=720

I got the following error: 

Do you have an idea?

Thanks a lot,

Mariem

Hello

Our expert, Fabiana, who handles this thread, is out of the office until 25 September. Please expect a delay in responses.

Thanks.

Hello,

Thank you for the information.

Sure thanks.

Hi Mariem,

Can you validate that you are able to run one of the IMX219 TI demo applications and view the results on your PC?

See: https://software-dl.ti.com/jacinto7/esd/robotics-sdk/10_00_00/TDA4VM/docs/source/docker/setting_docker_ros2.html#run-demo-applications

Thank you,

Fabiana

Hello Fabiana,

Unfortunately the examples are not working.

When I launch the object detection example of IMX219 I have No image detected in RVIZ (on the PC)

In the following screenshot you can see that my camera is detected:

In the next screenshots the launch of the ros node on the target and the result on the PC:

DO you have an idea why it is not working? I can see an error when I executed the example on the targe: [ERROR] [1727446820.197511301] [camera_calibration_parsers]: Unable to open camera calibration file [/opt/imaging/imx390/imx390_35244_equidistant_1280x720_rect.yaml]

If it is the cause of the problem, how can I solve it? Because I could not find the yaml file.

Thanks a lot,

Mariem

Hi Mariem,

Did you follow the robotics SDK setup instructions? If not, follow the steps outlined in the following pages and let me know if you have any questions.

https://software-dl.ti.com/jacinto7/esd/robotics-sdk/10_00_00/TDA4VM/docs/source/docker/README.html

https://software-dl.ti.com/jacinto7/esd/robotics-sdk/10_00_00/TDA4VM/docs/source/docker/setting_docker_ros2.html

Thank you,

Fabiana