Skip to content

Commit 209760e

Browse files
authored
add benchmark results on Atlas 200I DK A2 (#225)
Currently we have problem with NPU drivers (not opencv issues). After it is figured out we will add results on the NPU Ascend 310B.
1 parent fc30423 commit 209760e

File tree

3 files changed

+1528
-1227
lines changed

3 files changed

+1528
-1227
lines changed

benchmark/README.md

+51-6
Original file line numberDiff line numberDiff line change
@@ -933,14 +933,59 @@ mean median min input size model
933933
13.64 16.27 8.90 [1280, 720] CRNN with ['text_recognition_CRNN_EN_2021sep.onnx']
934934
```
935935
936-
<!--
936+
### Atlas 200I DK A2
937937
938-
### Atlas 200I DK
938+
Specs: https://www.hiascend.com/hardware/developer-kit-a2 (cn)
939+
- CPU: 4 core * 1.0 GHz
940+
- NPU: Ascend 310B, 8 TOPS INT8, 4 TFLOPS FP16 (Benchmark results are coming later)
939941
940942
CPU:
941-
943+
<!-- config wechat is excluded due to it needs building with opencv_contrib -->
942944
```
943-
88.24 87.00 84.23 [1280, 720] VitTrack with ['object_tracking_vittrack_2023sep.onnx']
945+
$ python3 benchmark.py --all --cfg_exclude wechat
946+
Benchmarking ...
947+
backend=cv.dnn.DNN_BACKEND_OPENCV
948+
target=cv.dnn.DNN_TARGET_CPU
949+
mean median min input size model
950+
6.67 6.80 5.17 [160, 120] YuNet with ['face_detection_yunet_2023mar.onnx']
951+
8.70 9.22 5.17 [160, 120] YuNet with ['face_detection_yunet_2023mar_int8.onnx']
952+
78.90 81.48 74.18 [150, 150] SFace with ['face_recognition_sface_2021dec.onnx']
953+
113.79 115.49 74.18 [150, 150] SFace with ['face_recognition_sface_2021dec_int8.onnx']
954+
36.94 38.64 33.23 [112, 112] FacialExpressionRecog with ['facial_expression_recognition_mobilefacenet_2022july.onnx']
955+
55.14 60.34 33.23 [112, 112] FacialExpressionRecog with ['facial_expression_recognition_mobilefacenet_2022july_int8.onnx']
956+
56.00 55.56 51.99 [224, 224] MPHandPose with ['handpose_estimation_mediapipe_2023feb.onnx']
957+
71.09 72.20 51.99 [224, 224] MPHandPose with ['handpose_estimation_mediapipe_2023feb_int8.onnx']
958+
78.01 80.36 73.97 [192, 192] PPHumanSeg with ['human_segmentation_pphumanseg_2023mar.onnx']
959+
111.56 113.84 73.97 [192, 192] PPHumanSeg with ['human_segmentation_pphumanseg_2023mar_int8.onnx']
960+
70.20 68.69 65.12 [224, 224] MobileNet with ['image_classification_mobilenetv1_2022apr.onnx']
961+
61.72 63.39 48.28 [224, 224] MobileNet with ['image_classification_mobilenetv2_2022apr.onnx']
962+
80.12 54.37 48.28 [224, 224] MobileNet with ['image_classification_mobilenetv1_2022apr_int8.onnx']
963+
87.42 96.71 48.28 [224, 224] MobileNet with ['image_classification_mobilenetv2_2022apr_int8.onnx']
964+
417.31 417.30 406.17 [224, 224] PPResNet with ['image_classification_ppresnet50_2022jan.onnx']
965+
597.15 619.24 406.17 [224, 224] PPResNet with ['image_classification_ppresnet50_2022jan_int8.onnx']
966+
155.73 153.40 145.10 [320, 240] LPD_YuNet with ['license_plate_detection_lpd_yunet_2023mar.onnx']
967+
200.41 200.24 145.10 [320, 240] LPD_YuNet with ['license_plate_detection_lpd_yunet_2023mar_int8.onnx']
968+
253.05 252.73 245.91 [416, 416] NanoDet with ['object_detection_nanodet_2022nov.onnx']
969+
274.44 269.76 245.91 [416, 416] NanoDet with ['object_detection_nanodet_2022nov_int8.onnx']
970+
1407.75 1416.44 1357.23 [640, 640] YoloX with ['object_detection_yolox_2022nov.onnx']
971+
1716.25 1709.35 1357.23 [640, 640] YoloX with ['object_detection_yolox_2022nov_int8.onnx']
972+
37.02 37.66 32.50 [1280, 720] VitTrack with ['object_tracking_vittrack_2023sep.onnx']
973+
92.56 97.78 87.87 [192, 192] MPPalmDet with ['palm_detection_mediapipe_2023feb.onnx']
974+
119.29 123.56 87.87 [192, 192] MPPalmDet with ['palm_detection_mediapipe_2023feb_int8.onnx']
975+
90.13 90.75 87.78 [224, 224] MPPersonDet with ['person_detection_mediapipe_2023mar.onnx']
976+
285.75 284.54 278.06 [128, 256] YoutuReID with ['person_reid_youtu_2021nov.onnx']
977+
389.02 405.12 278.06 [128, 256] YoutuReID with ['person_reid_youtu_2021nov_int8.onnx']
978+
83.16 85.91 77.83 [256, 256] MPPose with ['pose_estimation_mediapipe_2023mar.onnx']
979+
219.28 220.74 214.53 [640, 480] PPOCRDet with ['text_detection_cn_ppocrv3_2023may.onnx']
980+
217.18 227.44 207.15 [640, 480] PPOCRDet with ['text_detection_en_ppocrv3_2023may.onnx']
981+
319.73 210.22 207.15 [640, 480] PPOCRDet with ['text_detection_cn_ppocrv3_2023may_int8.onnx']
982+
396.47 399.45 207.15 [640, 480] PPOCRDet with ['text_detection_en_ppocrv3_2023may_int8.onnx']
983+
165.34 172.10 156.36 [1280, 720] CRNN with ['text_recognition_CRNN_CH_2021sep.onnx']
984+
169.22 174.21 156.36 [1280, 720] CRNN with ['text_recognition_CRNN_CN_2021nov.onnx']
985+
158.82 172.23 135.52 [1280, 720] CRNN with ['text_recognition_CRNN_EN_2021sep.onnx']
986+
159.39 156.42 135.52 [1280, 720] CRNN with ['text_recognition_CRNN_CH_2023feb_fp16.onnx']
987+
155.87 146.82 135.52 [1280, 720] CRNN with ['text_recognition_CRNN_EN_2023feb_fp16.onnx']
988+
163.43 152.16 135.52 [1280, 720] CRNN with ['text_recognition_CRNN_CH_2022oct_int8.onnx']
989+
173.46 162.85 135.52 [1280, 720] CRNN with ['text_recognition_CRNN_CN_2021nov_int8.onnx']
990+
175.28 145.22 135.52 [1280, 720] CRNN with ['text_recognition_CRNN_EN_2022oct_int8.onnx']
944991
```
945-
946-
-->

0 commit comments

Comments
 (0)