This repository was archived by the owner on Jan 3, 2023. It is now read-only.
FFmpeg video analytics release v0.2
Pre-release
Pre-release
New in Release v0.2
- In this initial release, it enables FFmpeg analytics pipeline with the elementary inference features, including:
- Support OpenVINO 2019 R1.1 release.
- Support Inference acceleration on Intel hardware (including CPU, GPU, VPU) supported by Intel®
OpenVINOTM Toolkit. - The "detect" filter supports the following DL models:
a. face-detection-adas-0001
b. face-detection-retail-0004
c. face-person-detection-retail-0002
d. person-detection-retail-0013
e. pedestrian-detection-adas-0002
f. pedestrian-and-vehicle-detector-adas-0001
g. vehicle-detection-adas-0002
h. person-vehicle-bike-detection-crossroad-0078
i. vehicle-license-plate-detection-barrier-0106
j. mobilenet-ssd - The "classify" filter supports the following models:
a. age-gender-recognition-retail-0013
b. emotions-recognition-retail-0003
c. face-reidentification-retail-0095
d. vehicle-attributes-recognition-barrier-0039
e. license-plate-recognition-barrier-0001
f. person-attributes-recognition-crossroad-0230 - For each inference filter, it supports “interval” option which specify the feature to do inference for every
N frame.
Known Issues/limitations
- This release is subject to the following limitations:
- The inference filters work on latency mode only, it doesn’t support IE’s batch processing mode and
async API, so throughput mode is not supported in this release. Which means, running on Xeon CPU
or accelerator cards which contains multiple VPUs can't get best performance of throughput. - OpenVINO doesn't support C API up to 2019 R1.1 release, so we provided the C-Wrap API for the
inference engine at https://github.com/VCDP/FFmpeg-patch/tree/master/thirdparty. This C API of IE is
subject to update accordingly and it would be removed when OpenVINO support IE’s C-API officially. - “iemetadata” format supports limited number of pre-defined metadata format for use cases, including
objects detection, emotion, age, gender.