Open main menu

DAVE Developer's Wiki β

ML-TN-005 — Real-time Social Distancing and video streaming on Orca SBC

Revision as of 15:05, 6 December 2021 by U0001 (talk | contribs)

Info Box
NeuralNetwork.png Applies to Machine Learning



Version Date Notes
1.0.0 December 2021 First public release


This Technical Note (TN for short) illustrates an interesting use case of the i.MX8M Plus-powered Orca Single Board Computer. In a nutshell, this example demonstrates the following functionalities, which are typical for many video processing applications:

  • Capturing live video streams from MIPI CSI-2 cameras
  • Hardware-accelerated color space conversion (GPU-powered)
  • Hardware-accelerated real-time inferencing (NPU-powered)
  • Hardware-accelerated video encoding (two streams)
  • Hardware-accelerated video decoding (two streams)
  • Hardware-accelerated GUI (GPU)


Basically, the testbed consists of two Orca SBC's connected as shown in the following diagram.


Orca SBC #1 is also interfaced to the following camera modules by Basler:

  • daa2500-60mc
  • daa3840-30mc

Both SBC's run Yocto Linux based on the 5.4.70 BSP by NXP.


Camera modules interfacingEdit

The camera modules are connected to the MIPI CSI-2 ports of the i.MX8M Plus. Each one exploits 4 MIPI lanes.

The camera modules are configured TBD

  • camera module #1: daa2500-60mc
    • resolution: 640x360
    • frame rate: 15fps
  • camera module #2: daa3840-30mc
    • resolution:
    • frame rate:

Video streams processingEdit

Camera module #1 stream

Social Distancing algorithmEdit

The Social Distancing algorithm is described in detail in ML-TN-002_-_Real-time_Social_Distancing_estimation this document.


A GUI application runs on the Orca SBC #1 too. This application is engineered with Crank Storyboard 6 and shows some parameters of the Social Distancing algorithm.