3,260
edits
Changes
m
===Gstreamer-based applications===For the sake of completeness, for each use case the full command line used to run the test applicaiton application is provided.==== Video decoding and playing====Output System software is HDMI port conneted to Full HD screenbased on [[Naon Embedded Linux Kit (NELK)]].
=====Use case #2=====* Description: playing H264 MP5 MP4 video 1920x1080@30fps demuxed video only
=====Use case #3=====* Description: playing two videos (both are hrdware decoded)Videos H264Raw ** video #1: H264 Raw 1920x1080 and @25fps** video #2: H264 Raw 848x360 @25fps * CPU usage: 65%<preclass="board-terminal">
Video mp4 H264 1920x1080 and H264raw 480p with overlay.<pre class="board-terminal">gst-launch -v v4l2src device="/dev/video0" always-copy=false queue-size=6 num-buffers=-1 ! 'video/x-raw-yuv-strided,format=(fourcc)NV12,width=1920,height=1080,framerate=(fraction)60/1' ! omxbufferalloc silent=false numBuffers=6 ! omx_scaler ! omx_ctrl display-mode=OMX_DC_MODE_1080P_60 ! gstperf ! omx_videosink sync=false</pre>
[[File:PipFull.jpg|400px]]==== V4L2 1080p60 Capture/H264 encoding/HDMI display ====
CPU 92%<preclass="board-terminal">gst-launch omx_videomixer portv4l2src device="/dev/video0" always-indexcopy=0 frameratefalse queue-size=25 name12 num-buffers=mix sink_00::outX1000 ! 'video/x-raw-yuv-strided,format=0 sink_00::outY=0 sink_00::outWidth(fourcc)NV12,width=1920 sink_00::outHeight,height=1080 sink_01::outX,framerate=360 sink_01::outY(fraction)60/1' ! omxbufferalloc silent=150 sink_01::outWidth=848 sink_01::outHeightfalse numBuffers=360 12 ! omx_ctrl display-mode=OMX_DC_MODE_1080P_60 ! omx_videosink sync=false filesrc locationomx_mdeiscaler name=/home/root/working-dir/480p-ice-intd d.h264 src_01 ! 'video/x omx_h264enc force-h264' ! h264parse accessidr-unitperiod=true ! omx_h264dec ! clockoverlay halign=center valign=bottom text300 i-period="UTC time:" shaded-background100 bitrate=true 5000000 ! mix. filesrc filesink location="/home/root/working-dir/1080p-131852575v4l2cap.h264 d.mp4" src_00 ! qtdemux nameomx_ctrl display-mode=demux demux.video_00 OMX_DC_MODE_1080P_60 ! queue gstperf ! nal2bytestream_h264 ! omx_h264dec ! mix.omx_videosink display-mode=OMX_DC_MODE_1080P_60
Videomix FullHD 1920x1080@30fps and streaming H264 only video 320x240 rescaled in HW with overlay==v4l2-based applications==This section provides some examples of applications based on well-known [http://en.wikipedia.org/wiki/Video4Linux|Video4Linux API].
CPU 30%<pre>gst-launch omx_videomixer port-index=0 framerate=25 namesaLoopBack =mix sink_00::outX=0 sink_00::outY=0 sink_00::outWidth=1920 sink_00::outHeight=1080 sink_01::outX=360 sink_01::outY=150 sink_01::outWidth=848 sink_01::outHeight=360 ! omx_ctrl display-code=OMX_DC_MODE_1080P_60 ! omx_videosink sync=false rtspsrc location=rtsp://192.168.0.33:5544 ! rtph264depay ! h264parse access-unit=true ! omx_h264dec ! clockoverlay halign=center valign=bottom text="UTC time:" shaded-background=true ! mix. filesrc location="/home/root/working-dir/1080p-131852575.mp4" ! qtdemux name=demux demux.video_00 ! queue ! nal2bytestream_h264 ! omx_h264dec ! mix.</pre>
Stream H264 320x240 rescaled at 800x600download [http://staticwave.ca/source/uvccapture/uvccapture-0.5.tar.bz2 uvccapture], compile it on target
CPU 9%<preclass="board-terminal">gst-launch rtspsrc location=rtsp$ wget http://192staticwave.168ca/source/uvccapture/uvccapture-0.5.tar.bz2$ tar xvjf uvccapture-0.33:5544 ! rtph264depay ! h264parse access5.tar.bz$ cd uvccapture-unit=true ! omx_h264dec ! omx_scaler ! '0.5$ make clean$ make allvideo$ uvccapture -v -d/dev/xvideo0 -x1280 -y720 -rawt0 -yuv,width=800,height=600' !omx_ctrl displayosnapshot.jpg -mode=OMX_DC_MODE_1080P_60 ! omx_videosink sync=falseq95
Video mp4 1920x1080 Please note that no routing is enabled between the two interface is Dual EMAC mode by default. Linux userspace tool should be used to configure VLAN tagging and streaming H264 320x240 rescaled at 800x600 with clockoverlay packet routing rules.
[[File:PiPstreaming== Extending the root file system ==NELK root file system derives directly from the one delivered along with TI EZSDK. In order to enrich it by installing new pre-built packages, well-known '''opkg''' tool comes to help.jpg|400px]]
CPU 35%To configure opgk to retrieve pre-built packages from angstrom repository, please follow these instructions:
gst$ echo "src/gz angstrom-launch omx_videomixer port-index=0 framerate=25 name=mix sink_00::outX=0 sink_00::outY=0 sink_00::outWidth=1920 sink_00::outHeight=1080 sink_01::outX=360 sink_01::outY=150 sink_01::outWidth=800 sink_01::outHeight=600 ! omx_ctrl display-mode=OMX_DC_MODE_1080P_60 ! omx_videosink sync=false rtspsrc location=rtspbase http://192www.168.0.33:5544 ! rtph264depay ! h264parse accessangstrom-unit=true ! omx_h264dec ! clockoverlay halign=center valign=bottom text="UTC time:" shaded-background=true ! mixdistribution. filesrc location="org/feeds/unstable/homeipk/rootglibc/working-dirarmv7a/1080p-131852575.mp4base" ! qtdemux name=demux demux.video_00 ! queue ! nal2bytestream_h264! omx_h264dec ! mix>> /etc/opkg/opkg.conf$ opkg update
{{WorkInProgress}}Please note that '''packages provided by angstrom repository are not optimized for DM8148 media hardware blocks such as video codec'''. For this reason, pay attention to not replace DM8148-optimized applications and libraries provided by default root file system.
→V4L2 Capture, decimanted
{{InfoBoxTop}}
{{AppliesToNaonFamily}}
{{Applies To NaonEVB-Lite}}
{{Applies To NaonEVB-Mid}}
{{InfoBoxBottom}}
==Introduction==
This page lists some statistics and information about real use cases based on [[Naon Embedded Linux Kit (NELK)]].
'''N.B.''': before launching the gst pipelines, it is required to [http://bash.cyberciti.biz/guide/Source_command source] the /home/root/gst-nelk.sh included into the NELK root file system, which sets the following environment variables: <pre>export GST_REGISTRY=/home/root/gst-nelk_registry.binexport LD_LIBRARY_PATH=/opt/gst/libexport GST_PLUGIN_PATH=/opt/gst/lib/gstreamer-0.10export PATH=/opt/gst/bin:$PATHexport GST_PLUGIN_SCANNER=/opt/gst/libexec/gstreamer-0.10/gst-plugin-scanner</pre> === Video decoding and playing===Output is HDMI port connected to Full HD 46" TV screen. CPU usage referes refers to the process under test as reported by <code>top</code> application.=====Use case #1=====
* Description: playing H264 RAW video 1920x1080@25fps
* CPU usage: 30%
decode_display_a8host_debug.xv5T -w 1920 -h 1080 -f 25 -i /home/root/working-dir/battleship-ressurrecting_h1080p.h264
</pre>
* CPU usage: 12%
<pre class="board-terminal">
</pre>
gst-launch omx_videomixer port-index=0 framerate=25 name=mix sink_00::outX=0 sink_00::outY=0 sink_00::outWidth=1920 sink_00::outHeight=816 sink_01::outX=0 sink_01::outY=0 sink_01::outWidth=848 sink_01::outHeight=360 ! omx_ctrl display-mode=OMX_DC_MODE_1080P_60 ! omx_videosink sync=false filesrc location=/home/root/working-dir/480p-ice-int.h264 ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec ! mix. filesrc location=/home/root/working-dir/iceage4-1080p.h264 ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec ! mix.
</pre>
====Use case #4====This section shows some different video combinations with overlayed text.====Use case #4.1====* Description: playing two videos (both are hardware decoded)Same videos ** video #1: H264 Raw 1920x1080 @25fps with text in overlay on FullHD ClockOverlay** video.#2: H264 Raw 848x360 @25fps* CPU usage: 95%<preclass="board-terminal">
gst-launch omx_videomixer port-index=0 framerate=25 name=mix sink_00::outX=0 sink_00::outY=0 sink_00::outWidth=1920 sink_00::outHeight=816 sink_01::outX=360 sink_01::outY=150 sink_01::outWidth=848 sink_01::outHeight=360 ! omx_ctrl display-mode=OMX_DC_MODE_1080P_60 ! omx_videosink sync=false filesrc location=/home/root/working-dir/480p-ice-int.h264 ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec ! mix. filesrc location=/home/root/working-dir/iceage4-1080p.h264 ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec ! clockoverlay halign=left valign=bottom text="UTC time:" shaded-background=true ! mix.
</pre>
====Use case #4.2====* Description: playing two videos (both are hardware decoded) with no overlap Video ** video #1: H264 Raw 1920x1080 @25fps rescaled in HW and hardware to 1280x720** video #2: H264 Raw 848x360 @25fps with ClockOverlay* CPU usage: 95%<pre class="board-terminal">gst-launch omx_videomixer port-index=0 framerate=25 name=mix sink_00::outX=0 sink_00::outY=0 sink_00::outWidth=1280 sink_00::outHeight=720 sink_01::outX=1072 sink_01::outY=720 sink_01::outWidth=848 sink_01::outHeight=360 ! omx_ctrl display-mode=OMX_DC_MODE_1080P_60 ! omx_videosink sync=false filesrc location=/home/root/working-dir/480p with textoverlay-ice-int.h264 ! 'video/x-h264,framerate=(fraction)30000/1252' ! h264parse access-unit=true ! omx_h264dec ! clockoverlay halign=center valign=bottom text="UTC time:" shaded-background=true ! mix. filesrc location=/home/root/working-dir/battleship-ressurrecting_h1080p.h264 ! 'video/x-h264,framerate=(fraction)30000/1252' ! h264parse access-unit=true ! omx_h264dec ! mix. </pre>
[[File:PiPseparated.jpg|400px]]
====Use case #4.3====
* Description: playing two videos (both are hardware decoded)
** video #1: H264 MP4 1920x1080 @30fps demuxed only video
** video #2: H264 Raw 848x360 @25fps with ClockOverlay
* CPU usage: 92%
<pre class="board-terminal">
gst-launch omx_videomixer port-index=0 framerate=25 name=mix sink_00::outX=0 sink_00::outY=0 sink_00::outWidth=1920 sink_00::outHeight=1080 sink_01::outX=360 sink_01::outY=150 sink_01::outWidth=848 sink_01::outHeight=360 ! omx_ctrl display-mode=OMX_DC_MODE_1080P_60 ! omx_videosink sync=false filesrc location=/home/root/working-dir/480p-ice-int.h264 ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec ! clockoverlay halign=center valign=bottom text="UTC time:" shaded-background=true ! mix. filesrc location="/home/root/working-dir/1080p-131852575.mp4" ! qtdemux name=demux demux.video_00 ! queue ! nal2bytestream_h264 ! omx_h264dec ! mix.
</pre>
[[File:PipFull.jpg|400px]]
====Use case #4.4====* Description: playing two videos (both are hardware decoded)** video #1: H264 MP4 1920x1080 @30fps demuxed only video** video #2: Streaming H264 video only, 320x240 rescaled in HW to 848x360 with Clockoverlay* CPU 95usage: 30%<preclass="board-terminal">gst-launch omx_videomixer port-index=0 framerate=25 name=mix sink_00::outX=0 sink_00::outY=0 sink_00::outWidth=1280 1920 sink_00::outHeight=720 1080 sink_01::outX=1072 360 sink_01::outY=720 150 sink_01::outWidth=848 sink_01::outHeight=360 ! omx_ctrl display-modecode=OMX_DC_MODE_1080P_60 ! omx_videosink sync=false filesrc rtspsrc location=rtsp:/home/root/working-dir/480p-ice-int192.168.0.h264 33:5544 ! 'video/x-h264,framerate=(fraction)30000/1252' rtph264depay ! h264parse access-unit=true ! omx_h264dec ! clockoverlay halign=center valign=bottom text="UTC time:" shaded-background=true ! mix. filesrc location="/home/root/working-dir/battleship1080p-ressurrecting_h1080p131852575.h264 mp4" ! 'video/x-h264,framerateqtdemux name=(fraction)30000/1252' demux demux.video_00 ! queue ! h264parse access-unit=true nal2bytestream_h264 ! omx_h264dec ! mix.
</pre>
====Use case #4.5====
* Description: Stream H264 320x240 rescaled at 800x600
* CPU usage: 9%
<pre class="board-terminal">
gst-launch rtspsrc location=rtsp://192.168.0.33:5544 ! rtph264depay ! h264parse access-unit=true ! omx_h264dec ! omx_scaler ! '
video/x-raw-yuv,width=800,height=600' !omx_ctrl display-mode=OMX_DC_MODE_1080P_60 ! omx_videosink sync=false
</pre>
====Use case #4.6====
* Description: playing two videos (both are hardware decoded)
** video #1: H264 MP4 1920x1080 @30fps demuxed only video
** video #2: Streaming H264 video only, 320x240 rescaled in HW to 800x600 with Clockoverlay
* CPU usage: 35%
<pre class="board-terminal">
gst-launch omx_videomixer port-index=0 framerate=25 name=mix sink_00::outX=0 sink_00::outY=0 sink_00::outWidth=1920 sink_00::outHeight=1080 sink_01::outX=360 sink_01::outY=150 sink_01::outWidth=800 sink_01::outHeight=600 ! omx_ctrl display-mode=OMX_DC_MODE_1080P_60 ! omx_videosink sync=false rtspsrc location=rtsp://192.168.0.33:5544 ! rtph264depay ! h264parse access-unit=true ! omx_h264dec ! clockoverlay halign=center valign=bottom text="UTC time:" shaded-background=true ! mix. filesrc location="/home/root/working-dir/1080p-131852575.mp4" ! qtdemux name=demux demux.video_00 ! queue ! nal2bytestream_h264! omx_h264dec ! mix.
</pre>
[[File:PiPstreaming.jpg|400px]]
=== Video capture and encoding ===
==== V4L2 1080p60 Capture/HDMI display ====
* Description:
** 1080p60 video is captured from VIN0A using v4l2src gstreamer component
** output displayed on HDMI at the same resolution
* Description:
** 1080p60 video is captured from VIN0A using v4l2src gstreamer component
** DEI/Scaler is used to split the source
** the former goes to H264 encoder (result saved to file)
** the latter goes to HDMI output
</pre>
==== V4L2 Capture, decimated ====
* Description
** 1080p50 video is captured from VIN1A using v4l2src
** input is decimated to 10 fps, using the same v4l2src
** output is displayed on HDMI
<pre class="board-terminal">
gst-launch -v v4l2src device="/dev/video2" always-copy=false queue-size=12 num-buffers=-1 decimate=5 ! 'video/x-raw-yuv-strided,format=(fourcc)NV12,width=1920,height=1080,framerate=(fraction)50/1' ! omxbufferalloc silent=false numBuffers=12 ! omx_scaler ! omx_ctrl display-mode=OMX_DC_MODE_1080P_60 ! gstperf ! omx_videosink sync=false
</pre>
This sample program capture a video stream on v4l2 input and display the frames on v4l2 output. More information regarding the software can be found on [http://processors.wiki.ti.com/index.php/TI81XX_Video_Capture_Driver_User_Guide#saLoopBack this] TI wiki article.
== UVCcapture Tool ==
This utility take a snapshot for USB WebCAM using v4l2 driver class uvc
</pre>
== Dual EMAC mode (NaonEVB-Lite)==
The two Ethernet interfaces on [[Category:NaonEVB-Lite|NaonEVB-Lite]] can be used as:
* Ethernet switch: Linux sees only one Ethernet interface and packets are routed between the two ports like a standard Ethernet switch does.
* Dual EMAC Mode: Linux sees two independent Ethernet interfaces and packet are routed between the two like a Ethernet router does.
The default configuration provided with [[Naon Embedded Linux Kit (NELK)]] is ''Dual EMAC Mode'', where ''eth0'' is the [[Category:Naon|Naon]] on-board 10/100Mbit Ethernet interface, while eth1 is the [[Category:NaonEVB-Lite|NaonEVB-Lite]] Gigabit interface.
The official TI documentation to enable and use Dual EMAC is [http://processors.wiki.ti.com/index.php/DM814x_AM387x_Ethernet_Switch_User_Guide#Dual_Standalone_EMAC_mode here]
The following instructions describes how to configure opkg in order to add more packages in order to provide a richer set of libraries, tools and applications.
<pre>
</pre>
