Difference between revisions of "ML-TN-005 — Real-time Social Distancing and video streaming on Orca SBC"

From DAVE Developer's Wiki
Jump to: navigation, search
(Created page with "{{InfoBoxTop}} {{AppliesToMachineLearning}} {{AppliesTo Machine Learning TN}} {{AppliesTo ORCA TN}} {{AppliesTo ORCA SBC TN}} {{InfoBoxBottom}} __FORCETOC__ == History == {|...")
 
Line 21: Line 21:
  
 
==Introduction==
 
==Introduction==
 +
This Technical Note (TN for short) illustrates an interesting use case of the i.MX8M Plus-powered [[ORCA_SBC|Orca Single Board Computer]]. In a nutshell, this example demonstrates the following functionalities, which are typical for many video processing applications:
 +
* Capturing live video streams from MIPI CSI-2 cameras
 +
* Hardware-accelerated color space conversion (GPU-powered)
 +
* Hardware-accelerated real-time inferencing (NPU-powered)
 +
* Hardware-accelerated video encoding (two streams)
 +
* Hardware-accelerated video decoding (two streams)
 +
* Hardware-accelerated GUI (GPU)
 +
 +
==Testbed==
 +
Basically, the testbed consists of two Orca SBC's connected as shown in the following diagram.
 +
 +
TBD
 +
 +
Both SBC's run Yocto Linux based on the 5.4.70 BSP by NXP.

Revision as of 14:36, 6 December 2021

Info Box
NeuralNetwork.png Applies to Machine Learning


History[edit | edit source]

Version Date Notes
1.0.0 December 2021 First public release

Introduction[edit | edit source]

This Technical Note (TN for short) illustrates an interesting use case of the i.MX8M Plus-powered Orca Single Board Computer. In a nutshell, this example demonstrates the following functionalities, which are typical for many video processing applications:

  • Capturing live video streams from MIPI CSI-2 cameras
  • Hardware-accelerated color space conversion (GPU-powered)
  • Hardware-accelerated real-time inferencing (NPU-powered)
  • Hardware-accelerated video encoding (two streams)
  • Hardware-accelerated video decoding (two streams)
  • Hardware-accelerated GUI (GPU)

Testbed[edit | edit source]

Basically, the testbed consists of two Orca SBC's connected as shown in the following diagram.

TBD

Both SBC's run Yocto Linux based on the 5.4.70 BSP by NXP.