Applications

Our cameras are HVS hybrid vision — one chip outputs both image (APS) and events (EVS). This page organizes "what HVS is good for" by application area and maps it to our ready-made samples / algorithms / capabilities; items marked "to be confirmed" are directions where HVS has an advantage but we do not yet provide a ready-made sample. For the HVS principle see HVS Hybrid Vision, and for the sample list see Samples Overview.

Capability quick reference

Application directionOur ready-made capabilityEntry point
Person / gesture detection✓ HumanDetector / HandDetectorWindows Algo SDK
Optical flow / motion analysis✓ OpticalFlowWindows Algo SDK
Remote monitoring / multi-camera✓ EVS Server / Web Window / Time SyncNetworking capabilities
Denoising (basic)✓ 7 denoise algorithmsHybrid Vision Algo
High-end imaging (interpolation/deblurring/super-res)To be confirmedsee below
Smart driving (HDR/FCW)To be confirmedsee below

1. Detection & perception: person / gesture

The natural use of HVS — use EVS "there is movement" for low-power triggering and detection, then use APS for a frame to confirm detail.

  • Person detection: HumanDetector (EVS input → bounding boxes vector<Rect>).
  • Gesture detection: HandDetector (EVS input → bounding boxes + keypoints vector<vector<Point2f>>).

Both are in the Windows Algo SDK and provide pretrained models. Effect illustration (our existing demo):

Person detection demoGesture detection demo

2. Motion analysis: optical flow

Event cameras have no motion blur, so estimating optical flow between adjacent event frames is fast and accurate. OpticalFlow (Of::run + showOf arrow visualization) outputs a per-pixel (vx, vy) optical-flow field, suited to high-speed motion-direction analysis and SLAM front-ends. See Windows Algo SDK — OpticalFlow.

Optical flow demo

3. Remote monitoring & multi-device: low-bandwidth streaming

Events are sparse and inherently low-bandwidth, well suited to remote / multi-camera monitoring:

  • EVS Network Server: TCP real-time event-stream push (default 8888) → EVS Server
  • Web Window: PC / mobile web remote viewing and control → Web Window
  • EVS Time Sync: UDP microsecond-level multi-device time sync (default 9999) → Time Sync

HVS advantage: remotely you can both view the event stream (low bandwidth, catches motion) and pull an APS frame on demand to confirm the scene.

4. Denoising: the foundation of every scenario

Event cameras have background activity noise, and almost every application must denoise first. Our Hybrid Vision Algo provides 7 denoise algorithms (double-window / event-flow / Khodamoradi / Yang / time-surface / recursive / MLP), usable alone or chained — see Programming Guide 04 — Event Denoising.

5. High-end imaging & smart driving (HVS-suitable, to be confirmed)

The HVS dual stream has clear theoretical advantages in the directions below, but we do not yet have ready-made samples — they are marked "to be confirmed". When needed, you can implement them yourself based on Toolkit + Algo, or contact R&D:

  • High-end imaging: frame interpolation (EVS-SlowMotion slow-motion reconstruction), deblurring, rolling-shutter correction, super-resolution — APS provides sharp frames, EVS fills in high-speed changes.
  • Smart driving / high dynamic range: Event HDR (EVS >100dB, no loss under sudden strong light), forward-collision warning (FCW), etc.

How to choose

What you want to doWhere to start
Run the minimum loopYour First C++ Program
Capture image + event dual stream (HVS demo)Programming Guide 07 — Capture APS Image
Person / gesture detectionWindows Algo SDK
Optical flow / motion analysisWindows Algo SDK — OpticalFlow
Remote viewing / multi-camera syncEVS Server / Time Sync
Denoise before processingProgramming Guide 04 — Event Denoising
Preview without code firstMultiVision Studio

Further reading