ML-TN-005 — Real-time Social Distancing and video streaming on Orca SBC
Info Box
|
Contents
HistoryEdit
| Version | Date | Notes |
|---|---|---|
| 1.0.0 | December 2021 | First public release |
IntroductionEdit
This Technical Note (TN for short) illustrates an interesting use case of the i.MX8M Plus-powered Orca Single Board Computer. In a nutshell, this example demonstrates the following functionalities, which are typical for many video processing applications:
- Capturing live video streams from MIPI CSI-2 cameras
- Hardware-accelerated color space conversion (GPU-powered)
- Hardware-accelerated real-time inferencing (NPU-powered)
- Hardware-accelerated video encoding (two streams)
- Hardware-accelerated video decoding (two streams)
- Hardware-accelerated GUI (GPU)
TestbedEdit
Basically, the testbed consists of two Orca SBC's connected as shown in the following diagram.
TBD
Orca SBC #1 is also interfaced to the following camera modules by Basler:
- daa2500-60mc
- daa3840-30mc
Both SBC's run Yocto Linux based on the 5.4.70 BSP by NXP.
ImplementationEdit
Camera modules interfacingEdit
The camera modules are connected to the MIPI CSI-2 ports of the i.MX8M Plus. Each one exploits 4 MIPI lanes.
The camera modules are configured TBD
- camera module #1: daa2500-60mc
- resolution: 640x360
- frame rate: 15fps
- camera module #2: daa3840-30mc
- resolution:
- frame rate:
Video streams processingEdit
Camera module #1 stream
Social Distancing algorithmEdit
The Social Distancing algorithm is described in detail in ML-TN-002_-_Real-time_Social_Distancing_estimation this document.
GUIEdit
A GUI application runs on the Orca SBC #1 too. This application is engineered with Crank Storyboard 6 and shows some parameters of the Social Distancing algorithm.
