SK-AM68: How can I make format H.265 or H.264 and streaming of USB Camera video?

KwangHyun Park

Prodigy 210 points

Part Number: SK-AM68
Other Parts Discussed in Thread: AM68

I'm trying to make input USB cam video to H.264 or H.265 format and streaming it through ethernet.

How can I try it?

Is there any example code or documents to make H.265/H.264 format and stream it?

over 1 year ago

0 Sarabesh Srinivasan over 1 year ago

TI__Genius 16520 points

Hello,

Currently working on providing you with these steps.
What SDK release are you using?

Regards,
Sarabesh S

0 Sarabesh Srinivasan over 1 year ago in reply to Sarabesh Srinivasan

TI__Genius 16520 points

Here are the steps I used to get my USB camera to stream h264/h265:

I used a logitech usb camera with supported resolution of 1280x720. Once I plugged the camera in I confirmed its connection with the log that prints on screen when hot plugged and with checking for video2 when I run ls /dev | grep video. The video# may be different for you.
On the host machine I created a file called XXXX.sdp (XXXX is the port number, Example: 8887.sdp) with these contents below:
```
m=video 8887 RTP.AVP 96
a=rtpmap:96 H264/90000
c=IN IP4 127.0.0.1
a=framerate:30
```
Specify the port you want to use in m=video XXXX RTP.AVP 96 (with XXXX being the port, Example: m=video 8887 RTP.AVP 96)
Additionally you need to have ffmpeg installed to run a ffplay command on your host machine.
Once I confirmed the camera is probed I can run the pipeline. Keep in mind the pipeline may differ based on what type of inputs your camera processes.
```
gst-launch-1.0 v4l2src device=/dev/video2 ! image/jpeg, width=1280, height=720 ! jpegparse ! jpegdec ! video/x-raw ! videoconvert ! v4l2h264enc extra-controls="enc,prepend_sps_and_pps_to_idr=1,video_gop_size=5" ! rtph264pay ! udpsink host=<yourip> port=<sdp port specified>
```
For my particular camera it uses these jpeg inputs so I specified decoding them to be reformatted to raw-video to be encoded to h264 in the pipeline.
For the host, enter your host-ip and for the port enter your sdp port specified in the .sdp file on your host machine.
Also, specify the correct v4l2src device whether it is video2, video3, or whatever it is configured to.
Once this pipeline is running, to view the stream on your host machine use this command:
```
ffplay -protocol_whitelist "file,rtp,udp" -i 8887.sdp
```
Replace the 8887 with whatever the port is that you've specified in the pipeline and the .sdp file on your host machine.

I am working on writing an FAQ about this query and will link it to this thread when complete as well.

Thank you,
Sarabesh S

0 Sarabesh Srinivasan over 1 year ago in reply to Sarabesh Srinivasan

TI__Genius 16520 points

Hello,

Here is the link to the FAQ regarding the question you asked:
e2e.ti.com/.../faq-sk-am68-how-can-i-get-started-with-streaming-h264-h265-from-a-camera-input

It goes over streaming to an external monitor display and streaming on host machine.

Thank you,
Sarabesh S

0 KwangHyun Park over 1 year ago in reply to Sarabesh Srinivasan

Prodigy 210 points

Is there any example C code for using gstreamer ?
I think your suggestion is just command in cmd prompt.

I want to use and make custom in C code (vision apps application)

0 KwangHyun Park over 1 year ago in reply to Sarabesh Srinivasan

Prodigy 210 points

My SDK ver. is 9.1.0

0 Sarabesh Srinivasan over 1 year ago in reply to KwangHyun Park

TI__Genius 16520 points

Hi,

Please expect a delay in response due to the holiday season.

Thank you,
Sarabesh S

0 KwangHyun Park over 1 year ago in reply to Sarabesh Srinivasan

Prodigy 210 points

Yes I know the reason of delay.

Have a nice holiday.

0 Brandon Brnich over 1 year ago in reply to KwangHyun Park

TI__Expert 3800 points

Hello,

The engineer is still out of office. They will get back to you when they return. We appreciate your patience.

Thanks,

Brandon

0 Sarabesh Srinivasan over 1 year ago in reply to Brandon Brnich

TI__Genius 16520 points

Hello,

KwangHyun Park said:
Is there any example C code for using gstreamer ?

There is no example C code available for this. All I can show you is how this can be done given what's supported by the CODEC, as per my previous answer.

Thank you,
Sarabesh S

0 KwangHyun Park over 1 year ago in reply to Sarabesh Srinivasan

Prodigy 210 points

Then can I know how to use the command of gstreamer in C code?

Because only just prompt command, I cannot make the tool.

0 Sarabesh Srinivasan over 1 year ago in reply to KwangHyun Park

TI__Genius 16520 points

Hi,

We have usecases for using gstreamer in C code in our vision apps component located in our RTOS SDK. You can view how it is used by downloading the RTOS SDK tarball for J721s2 here. Then looking in the vision_apps/apps/basic_demos/app_multi_cam_codec directory. In here you can see how we use gstreamer in our C code for this demo app in main.c with the construct_gst_strings function.

Thank you,
Sarabesh S

0 KwangHyun Park over 1 year ago in reply to Sarabesh Srinivasan

Prodigy 210 points

Thanks. It helps me.

And I wonder that TDA4AL cannot use gstreamer?

I used command on prompt as "gst-launch-1.0 v4l2src device=/dev/video2 ! image/jpeg, width=1280, height=720 ! jpegparse ! jpegdec ! video/x-raw ! videoconvert ! v4l2h264enc extra-controls="enc,prepend_sps_and_pps_to_idr=1,video_gop_size=5" ! rtph264pay ! udpsink host=192.168.105.1 port=8887"

but it doesn't works. It work on AM68_SK but not work on TDA4AL EVM

It occurs

I'm using same environment AM68_SK and TDA4AL EVM.

0 KwangHyun Park over 1 year ago in reply to Sarabesh Srinivasan

Prodigy 210 points

Oh Im sorry

When I reboot, It works well

Thank you

0 KwangHyun Park over 1 year ago in reply to Sarabesh Srinivasan

Prodigy 210 points

I'm customizing vision_apps application using gst wrapper.

So I added

but the compile error occurs that there is "undefined reference to" about appCodecInit appCodecStart appCodecDeInit appCodecStop.

should I add additional header file?

0 Sarabesh Srinivasan over 1 year ago in reply to KwangHyun Park

TI__Genius 16520 points

Hello,

I talked to our vision apps expert and he mentioned that vision apps is supported only on the EVM and not on the SK-Board's Edge AI SDK. Since the SK is the part number being referred to in this thread, that may be the problem.

However, as per the original question, the outlined steps and GStreamer pipeline along with app examples have been provided to show how h264/h265 USB-streaming can be done.
Since this is becoming a separate issue from the original query could you open a new thread regarding your errors when customizing vision apps.

Thank you,
Sarabesh S

Processors

Processors forum

SK-AM68: How can I make format H.265 or H.264 and streaming of USB Camera video?