私的AI研究会 > OpenModelZoo5
第11世代 CPU(Core™ i3) を搭載したノートパソコン「DELL Vostro 3500」で、OpenVINO™ツールキット付属のデモソフトを動かしその速度を調べる。
機種 | CPU/GPU |
① | Core™ i7-1185G7 + GPU (FP16) |
② | Core™ i7-1185G7 + GPU (FP32) |
③ | Core™ i7-1185G7 |
④ | Core™ i7-1185G7 + NCS2 |
⑤ | Core™ i5-10210 |
⑥ | Core™ i3-1115G4 |
⑦ | Core™ i3-1115G4 + NCS2 |
※ 動作環境は異なるので数値は参考値
$ cd ~/run_app/ $ ./_human_pose_estimation_3d_demo.sh [human_pose_estimation_3d_demo.sh] 'human_pose_estimation_3d_demo' Run !!・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_human_pose_estimation_3d_demo_16.sh [human_pose_estimation_3d_demo_16.sh] 'human_pose_estimation_3d_demo (NCS2)' Run !! Mean core utilization: 12.9% E: [global] [ 499010] [python3] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 499010] [python3] XLinkResetRemote:257 can't wait dispatcherClosedSem CPU: FPS 5.3 MYRIAD: FPS 4.0
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ |
fps | 41 | 30.2 | 13.8 | 4.1 | 13.5 | 4.7 | 4.0 |
$ cd ~/run_app/ $ ./_action_recognition.sh [action_recognition_demo.sh] 'action_recognition_demo' Run !! Reading IR... Loading IR to the plugin... Reading IR... Loading IR to the plugin... To close the application, press 'CTRL+C' here or switch to the output window and press Esc or Q Frame 15: Safe driving - 85.45% -- 10.91ms Frame 16: Safe driving - 87.28% -- 33.52ms : : Frame 124: Safe driving - 82.10% -- 115.30ms Frame 125: Safe driving - 81.08% -- 117.01ms Frame 126: Safe driving - 79.23% -- 119.67ms finishing <action_recognition_demo.steps.RenderStep object at 0x7fdbb09cb910> Data total: 2.74ms (+/-: 5.83) 365.10fps Data own: 2.72ms (+/-: 5.83) 367.02fps Encoder total: 23.73ms (+/-: 9.75) 42.15fps Encoder own: 23.71ms (+/-: 9.75) 42.17fps Decoder total: 93.11ms (+/-: 41.04) 10.74fps Decoder own: 93.10ms (+/-: 41.04) 10.74fps Render total: 156.47ms (+/-: 90.34) 6.39fps Render own: 156.54ms (+/-: 87.49) 6.39fps・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_action_recognition_16.sh [action_recognition_demo_16.sh] 'action_recognition_demo (NCS2)' Run !! Reading IR... Loading IR to the plugin... [Warning][VPU][Config] Deprecated option was used : VPU_HW_STAGES_OPTIMIZATION Reading IR... Loading IR to the plugin... To close the application, press 'CTRL+C' here or switch to the output window and press Esc or Q Frame 15: Safe driving - 84.79% -- 10.39ms Frame 16: Safe driving - 86.75% -- 11.10ms : : Frame 505: Safe driving - 85.53% -- 8.47ms Frame 506: Safe driving - 85.87% -- 8.54ms Frame 507: Safe driving - 86.01% -- 8.64ms finishing <action_recognition_demo.steps.RenderStep object at 0x7f628bd2daf0> Data total: 4.81ms (+/-: 5.29) 208.11fps Data own: 4.78ms (+/-: 5.26) 209.39fps Encoder total: 5.43ms (+/-: 5.14) 184.29fps Encoder own: 5.38ms (+/-: 5.12) 185.84fps Decoder total: 8.71ms (+/-: 7.30) 114.76fps Decoder own: 8.69ms (+/-: 7.28) 115.08fps Render total: 35.16ms (+/-: 29.89) 28.44fps Render own: 34.78ms (+/-: 28.90) 28.75fps E: [global] [ 917514] [python3] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 917514] [python3] XLinkResetRemote:257 can't wait dispatcherClosedSem
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ | |
Data totai | fps | 642 | 528 | 552 | 435 | 1152 | 365 | 208 |
ms | 1.56 | 1.89 | 1.81 | 2.30 | 0.87 | 2.74 | 4.81 | |
Encoder total | fps | 197 | 186 | 184 | 125 | 235 | 42 | 186 |
ms | 5.1 | 5.38 | 5.43 | 7.99 | 4.3 | 23.7 | 5.43 | |
Decoder total | fps | 1239 | 76.4 | 65.8 | 580 | 44 | 10.7 | 115 |
ms | 0.81 | 13.1 | 15.2 | 1.72 | 23 | 93.1 | 8.71 | |
Render total | fps | 30.4 | 21.7 | 23.6 | 31.8 | 27 | 6.39 | 28.44 |
ms | 33 | 46.1 | 42.4 | 31.4 | 37 | 156 | 35.2 |
$ cd ~/run_app/ $ ./_object_detection_python_demo.sh [object_detection_demo.sh] 'object_detection_demo' Run !! [ INFO ] Initializing Inference Engine... [ INFO ] Loading network... [ INFO ] Reading network from IR... [ INFO ] Loading network to CPU plugin... [ INFO ] Starting inference... To close the application, press 'CTRL+C' here or switch to the output window and press ESC key Latency: 689.5 ms FPS: 1.2・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_object_detection_python_demo_16.sh [object_detection_demo/_16.sh] 'object_detection_demo (NCS2)' Run !! [ INFO ] Initializing Inference Engine... [ INFO ] Loading network... [ INFO ] Reading network from IR... [ INFO ] Loading network to MYRIAD plugin... [ INFO ] Starting inference... To close the application, press 'CTRL+C' here or switch to the output window and press ESC key Latency: 432.0 ms FPS: 1.8 E: [global] [ 242120] [python3] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 242120] [python3] XLinkResetRemote:257 can't wait dispatcherClosedSem
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ |
Latency(ms) | 33.0 | 124 | 235 | 466 | 219.2 | 670 | 432 |
fps | 10.5 | 7.9 | 4.2 | 2.1 | 4.5 | 1.2 | 1.8 |
$ cd ~/run_app/ $ ./_human_pose_estimation.sh [human_pose_estimation_demo.sh] 'human_pose_estimation_demo' Run !! [ INFO ] Initializing Inference Engine... [ INFO ] Loading network... [ INFO ] Reading network from IR... [ INFO ] Reshape net to {'data': [1, 3, 256, 456]} [ INFO ] Loading network to CPU plugin... [ INFO ] Starting inference... To close the application, press 'CTRL+C' here or switch to the output window and press ESC key Latency: 162.9 ms FPS: 5.8・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_human_pose_estimation_16.sh [human_pose_estimation_demo_16.sh] 'human_pose_estimation_demo (NCS2)' Run !! [ INFO ] Initializing Inference Engine... [ INFO ] Loading network... [ INFO ] Reading network from IR... [ INFO ] Reshape net to {'data': [1, 3, 256, 456]} [ INFO ] Loading network to MYRIAD plugin... [ INFO ] Starting inference... To close the application, press 'CTRL+C' here or switch to the output window and press ESC key Latency: 214.6 ms FPS: 4.5 E: [global] [ 369237] [python3] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 369237] [python3] XLinkResetRemote:257 can't wait dispatcherClosedSem
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ |
Latency (ms) | 23.2 | 28.5 | 51.4 | 212 | 44.1 | 162.3 | 214.6 |
FPS | 38.8 | 32.2 | 18.5 | 4.5 | 17.3 | 5.3 | 4.5 |
$ cd ~/run_app/ $ ./_gesture_recognition_demo.sh [gesture_recognition_demo.sh] 'gesture_recognition_demo' Run !!
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ |
fps | 13.5 | 13.5 | 14.3 | X | 14.3 | 3.34 | X |
$ cd ~/run_app/ $ ./_handwritten_text_recognition_demo.sh [handwritten_text_recognition_demo.sh] 'handwritten_text_recognition_demo' Run !! [ INFO ] Loading network [ INFO ] Preparing input/output blobs [ INFO ] Loading model to the plugin [ INFO ] Starting inference (1 iterations) ['菊池朋子'] [ INFO ] Average throughput: 1129.4593811035156 ms・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_handwritten_text_recognition_demo_16.sh [handwritten_text_recognition_demo_16.sh] 'handwritten_text_recognition_demo (NCS2)' Run !! [ INFO ] Loading network [ INFO ] Preparing input/output blobs [ INFO ] Loading model to the plugin [ INFO ] Starting inference (1 iterations) ['菊池朋子'] [ INFO ] Average throughput: 921.0784435272217 ms E: [global] [ 62031] [python3] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 62031] [python3] XLinkResetRemote:257 can't wait dispatcherClosedSem
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ |
Average throughput(ms) | 52.7 | 91.2 | 373 | 314 | 277 | 1129 | 921 |
$ cd ~/run_app/ $ ./_text_detection_demo.sh [text_detection_demo.sh] 'text_detection_demo' Run !! InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Parsing input parameters [ INFO ] Loading Inference Engine [ INFO ] Device info: [ INFO ] CPU MKLDNNPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Loading network files [ INFO ] Starting inference To close the application, press 'CTRL+C' here or switch to the output window and press ESC or Q text detection model inference (ms) (fps): 385.5 2.59403 text detection postprocessing (ms) (fps): 70.15 14.2552 text recognition model inference (ms) (fps): 25.1893 39.6994 text recognition postprocessing (ms) (fps): 0.0175 57142.9 text crop (ms) (fps): 0.0678964 14728.3・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_text_detection_demo_16.sh [text_detection_demo_16.sh] 'text_detection_demo (NCS2)' Run !! InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Parsing input parameters [ INFO ] Loading Inference Engine [ INFO ] Device info: [ INFO ] MYRIAD myriadPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Loading network files [ INFO ] Starting inference To close the application, press 'CTRL+C' here or switch to the output window and press ESC or Q text detection model inference (ms) (fps): 667.417 1.49831 text detection postprocessing (ms) (fps): 63.4167 15.7687 text recognition model inference (ms) (fps): 78 12.8205 text recognition postprocessing (ms) (fps): 0.0170889 58517.6 text crop (ms) (fps): 0.123578 8092.07 E: [global] [ 434084] [text_detection_] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 434084] [text_detection_] XLinkResetRemote:257 can't wait dispatcherClosedSem
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ | |
detection model inference | ms | 40.9 | 62 | 103 | 648 | 102 | 386 | 667 |
fps | 24.5 | 16.1 | 9.68 | 1.54 | 9.8 | 2.59 | 1.50 | |
detection model postprocessing | ms | 73.7 | 90.7 | 56.9 | 86.6 | 40.4 | 70.2 | 63.4 |
fps | 13.6 | 11.0 | 17.6 | 11.5 | 24.7 | 14.3 | 15.8 | |
recognition model inference | ms | 54.3 | 59.0 | 8.14 | 76.6 | 7.1 | 25.2 | 76.1 |
fps | 18.4 | 16.9 | 122.9 | 13.1 | 140 | 40.0 | 12.8 | |
recognition model postprocessing | ms | 0.0091 | 0.0091 | 0.0094 | 0.018 | 0.007 | 0.0175 | 0.0171 |
fps | 109375 | 108834 | 106020 | 58852 | 136364 | 57143 | 58518 |
$ cd ~/run_app/ $ ./_crossroad_camera_demo.sh [crossroad_camera_demo.sh] 'crossroad_camera_demo' Run !! InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Parsing input parameters [ INFO ] Person Attributes Recognition detection DISABLED [ INFO ] Person Reidentification Retail detection DISABLED [ INFO ] Loading device CPU [ INFO ] CPU MKLDNNPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Loading network files for PersonDetection [ INFO ] Batch size is forced to 1 [ INFO ] Checking Person Detection inputs [ INFO ] Checking Person Detection outputs [ INFO ] Loading Person Detection model to the CPU device [ INFO ] Start inference To close the application, press 'CTRL+C' here or switch to the output window and press ESC key [ INFO ] Total Inference time: 6790.05 [ INFO ] Execution successful・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_crossroad_camera_demo_16.sh [crossroad_camera_demo_16.sh] 'crossroad_camera_demo (NCS2)' Run !! InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Parsing input parameters [ INFO ] Person Attributes Recognition detection DISABLED [ INFO ] Person Reidentification Retail detection DISABLED [ INFO ] Loading device MYRIAD [ INFO ] MYRIAD myriadPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Loading network files for PersonDetection [ INFO ] Batch size is forced to 1 [ INFO ] Checking Person Detection inputs [ INFO ] Checking Person Detection outputs [ INFO ] Loading Person Detection model to the MYRIAD device [ INFO ] Start inference To close the application, press 'CTRL+C' here or switch to the output window and press ESC key [ INFO ] Total Inference time: 7498.47
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ |
detection time(ms) | 20 | 17.6 | 24.3 | 269.2 | 30 | 81.0 | 270.7 |
fps | 74 | 56 | 40.1 | 3.71 | 32 | 12.34 | 3.69 |
$ cd ~/run_app/ $ ./_human_pose_estimation.sh [human_pose_estimation_demo.sh] 'human_pose_estimation_demo' Run !! [ INFO ] Initializing Inference Engine... [ INFO ] Loading network... [ INFO ] Reading network from IR... [ INFO ] Reshape net to {'data': [1, 3, 256, 456]} [ INFO ] Loading network to CPU plugin... [ INFO ] Starting inference... To close the application, press 'CTRL+C' here or switch to the output window and press ESC key Latency: 161.0 ms FPS: 6.0・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_human_pose_estimation_16.sh [human_pose_estimation_demo_16.sh] 'human_pose_estimation_demo (NCS2)' Run !! [ INFO ] Initializing Inference Engine... [ INFO ] Loading network... [ INFO ] Reading network from IR... [ INFO ] Reshape net to {'data': [1, 3, 256, 456]} [ INFO ] Loading network to MYRIAD plugin... [ INFO ] Starting inference... To close the application, press 'CTRL+C' here or switch to the output window and press ESC key Latency: 213.9 ms FPS: 4.5 E: [global] [ 809777] [python3] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 809777] [python3] XLinkResetRemote:257 can't wait dispatcherClosedSem
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ |
Latency (ms) | 23.5 | 28.7 | 51.8 | 212.2 | 43.4 | 161.0 | 213.9 |
FPS | 37.9 | 31.3 | 18.5 | 4.5 | 21.5 | 6.0 | 4.5 |
$ cd ~/run_app/ $ ./_object_detection_demo.sh [object_detection_demo.sh] 'object_detection_demo' Run !! [ INFO ] InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Parsing input parameters [ INFO ] Reading input [ INFO ] Loading Inference Engine [ INFO ] Device info: [ INFO ] CPU MKLDNNPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 Loading network files [ INFO ] Batch size is forced to 1. [ INFO ] Checking that the inputs are as the demo expects [ INFO ] Checking that the outputs are as the demo expects [ INFO ] Loading model to the device [ INFO ] Metric reports: Latency: 89.5 ms FPS: 21.0 [ INFO ] [ INFO ] The execution has completed successfully・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_object_detection_demo_16.sh [object_detection_demo_16.sh] 'object_detection_demo (NCS2)' Run !! [ INFO ] InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Parsing input parameters [ INFO ] Reading input [ INFO ] Loading Inference Engine [ INFO ] Device info: [ INFO ] MYRIAD myriadPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 Loading network files [ INFO ] Batch size is forced to 1. [ INFO ] Checking that the inputs are as the demo expects [ INFO ] Checking that the outputs are as the demo expects [ INFO ] Loading model to the device [ INFO ] Metric reports: Latency: 307.5 ms FPS: 15.7 [ INFO ] [ INFO ] The execution has completed successfully
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ |
Latency(ms) | 20.3 | 30.9 | 44.6 | 307.9 | 22 | 89.5 | 307.5 |
fps | 214.7 | 151.7 | 104.5 | 15.7 | 73.0 | 21.0 | 15.7 |
$ cd ~/run_app/ $ ./_smart_classroom_demo.sh [smart_classroom_demo.sh] 'smart_classroom_demo' Run !! [ INFO ] InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Parsing input parameters [ INFO ] Loading Inference Engine [ INFO ] Device info: [ INFO ] CPU MKLDNNPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ WARNING ] Face recognition models are disabled! To close the application, press 'CTRL+C' here or switch to the output window and press ESC key [ INFO ] Mean FPS: 6.301 [ INFO ] Frames processed: 61 [ INFO ] Execution successful・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_smart_classroom_demo_16.sh [smart_classroom_demo_16.sh] 'smart_classroom_demo (NCS2)' Run !! [ INFO ] InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Parsing input parameters [ INFO ] Loading Inference Engine [ INFO ] Device info: [ INFO ] MYRIAD myriadPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] CPU MKLDNNPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ WARNING ] Face recognition models are disabled! To close the application, press 'CTRL+C' here or switch to the output window and press ESC key [ INFO ] Mean FPS: 3.61141 [ INFO ] Frames processed: 30 E: [global] [ 5866] [smart_classroom] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 5866] [smart_classroom] XLinkResetRemote:257 can't wait dispatcherClosedSem
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ |
Mean Fps | 39.2 | 22.5 | 20.3 | 3.7 | 20 | 6.3 | 3.6 |
Frames processed | 363 | 87 | 117 | 25 | 168 | 61 | 30 |
$ cd ~/run_app/ $ ./_pedestrian_tracker_demo.sh [pedestrian_tracker_demo.sh] 'pedestrian_tracker_demo' Run !! InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 Loading device CPU CPU MKLDNNPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 To close the application, press 'CTRL+C' here or switch to the output window and press ESC key Execution successful・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_pedestrian_tracker_demo_16.sh [pedestrian_tracker_demo_16.sh] 'pedestrian_tracker_demo (NCS2)' Run !! InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 Loading device MYRIAD MYRIAD myriadPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 E: [global] [ 104719] [pedestrian_trac] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 104719] [pedestrian_trac] XLinkResetRemote:257 can't wait dispatcherClosedSem [ ERROR ] Failed to compile layer "736": Unsupported combination of indices in layer "736". Only across channel and full batch supported.※「2021.3」でNUC2実行エラー(非対応?)。
$ cd ~/run_app/ $ ./_super_resolution_demo.sh [super_resolution_demo.sh] 'super_resolution_demo' Run !! [ INFO ] InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Parsing input parameters [ INFO ] Files were added: 1 [ INFO ] /home/mizutu/Images/image-low.bmp [ INFO ] Loading Inference Engine [ INFO ] Device info: [ INFO ] CPU MKLDNNPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Loading network files [ INFO ] Preparing input blobs [ INFO ] Batch size is 1 [ INFO ] Preparing output blobs [ INFO ] Loading model to the device [ INFO ] Create infer request To close the application, press 'CTRL+C' here or switch to the output window and press any key [ INFO ] Start inference [ INFO ] Output size [N,C,H,W]: 1, 3, 1080, 1920 [ INFO ] Execution successful [ INFO ] This demo is an API example, for any performance measurements please use the dedicated benchmark_app tool from the openVINO toolkit・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_super_resolution_demo_16.sh [super_resolution_demo_16.sh] 'super_resolution_demo (NCS2)' Run !! [ INFO ] InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Parsing input parameters [ INFO ] Files were added: 1 [ INFO ] /home/mizutu/Images/image-low.bmp [ INFO ] Loading Inference Engine [ INFO ] Device info: [ INFO ] MYRIAD myriadPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Loading network files [ INFO ] Preparing input blobs [ INFO ] Batch size is 1 [ INFO ] Preparing output blobs [ INFO ] Loading model to the device [ INFO ] Create infer request To close the application, press 'CTRL+C' here or switch to the output window and press any key [ INFO ] Start inference [ INFO ] Output size [N,C,H,W]: 1, 3, 1080, 1920 E: [global] [ 205199] [super_resolutio] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 205199] [super_resolutio] XLinkResetRemote:257 can't wait dispatcherClosedSem [ INFO ] Execution successful [ INFO ] This demo is an API example, for any performance measurements please use the dedicated benchmark_app tool from the openVINO toolkit
$ cd ~/run_app/ $ ./_single_human_pose_estimation_demo.sh [single_human_pose_estimation_demo.sh] 'single_human_pose_estimation_demo' Run !!・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_single_human_pose_estimation_demo_16.sh [single_human_pose_estimation_demo_16.sh] 'single_human_pose_estimation_demo (NCS2)' Run !! E: [global] [ 268903] [python3] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 268903] [python3] XLinkResetRemote:257 can't wait dispatcherClosedSem
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ |
summary (fps) | 4.5 | 3.2 | 1.5 | 0.3 | 0.9 | 0.5 | 0.3 |
estimation (fps) | 18.1 | 10.0 | 4.7 | 1.5 | 5.6 | 1.5 | 1.6 |
detection (fps) | 140.2 | 118 | 78.3 | 26.3 | 109.9 | 20.1 | 23.9 |
$ cd ~/run_app/ $ ./_interactive_face_detection_demo.sh [interactive_face_detection_demo.sh] 'interactive_face_detection_demo' Run !! InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Parsing input parameters [ INFO ] Loading device CPU [ INFO ] CPU MKLDNNPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Loading network files for Face Detection [ INFO ] Batch size is set to 1 [ INFO ] Checking Face Detection network inputs [ INFO ] Checking Face Detection network outputs [ INFO ] Loading Face Detection model to the CPU device [ INFO ] Loading network files for Age/Gender Recognition network [ INFO ] Batch size is set to 16 for Age/Gender Recognition network [ INFO ] Checking Age/Gender Recognition network inputs [ INFO ] Checking Age/Gender Recognition network outputs [ INFO ] Loading Age/Gender Recognition model to the CPU plugin [ INFO ] Loading network files for Head Pose Estimation network [ INFO ] Batch size is set to 16 for Head Pose Estimation network [ INFO ] Checking Head Pose Estimation network inputs [ INFO ] Checking Head Pose Estimation network outputs [ INFO ] Loading Head Pose Estimation model to the CPU plugin [ INFO ] Loading network files for Emotions Recognition [ INFO ] Batch size is set to 16 for Emotions Recognition [ INFO ] Checking Emotions Recognition network inputs [ INFO ] Checking Emotions Recognition network outputs [ INFO ] Loading Emotions Recognition model to the CPU plugin [ INFO ] Loading network files for Facial Landmarks Estimation [ INFO ] Batch size is set to 16 for Facial Landmarks Estimation network [ INFO ] Checking Facial Landmarks Estimation network inputs [ INFO ] Checking Facial Landmarks Estimation network outputs [ INFO ] Loading Facial Landmarks Estimation model to the CPU plugin [ INFO ] Loading network files for Antispoofing Classifier network [ INFO ] Batch size is set to 16 for Antispoofing Classifier network [ INFO ] Checking Antispoofing Classifier network inputs [ INFO ] Checking Antispoofing Classifier network outputs [ INFO ] Loading Antispoofing Classifier model to the CPU plugin To close the application, press 'CTRL+C' here or switch to the output window and press Q or Esc [ INFO ] Number of processed frames: 41 [ INFO ] Total image throughput: 4.47617 fps [ INFO ] Execution successful・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_interactive_face_detection_demo_16.sh [interactive_face_detection_demo_16.sh] 'interactive_face_detection_demo (NCS2)' Run !! InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Parsing input parameters [ INFO ] Loading device MYRIAD [ INFO ] MYRIAD myriadPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Loading network files for Face Detection [ INFO ] Batch size is set to 1 [ INFO ] Checking Face Detection network inputs [ INFO ] Checking Face Detection network outputs [ INFO ] Loading Face Detection model to the MYRIAD device [ INFO ] Loading network files for Age/Gender Recognition network [ INFO ] Batch size is set to 16 for Age/Gender Recognition network [ INFO ] Checking Age/Gender Recognition network inputs [ INFO ] Checking Age/Gender Recognition network outputs [ INFO ] Loading Age/Gender Recognition model to the MYRIAD plugin [ INFO ] Loading network files for Head Pose Estimation network [ INFO ] Batch size is set to 16 for Head Pose Estimation network [ INFO ] Checking Head Pose Estimation network inputs [ INFO ] Checking Head Pose Estimation network outputs [ INFO ] Loading Head Pose Estimation model to the MYRIAD plugin [ INFO ] Loading network files for Emotions Recognition [ INFO ] Batch size is set to 16 for Emotions Recognition [ INFO ] Checking Emotions Recognition network inputs [ INFO ] Checking Emotions Recognition network outputs [ INFO ] Loading Emotions Recognition model to the MYRIAD plugin [ INFO ] Loading network files for Facial Landmarks Estimation [ INFO ] Batch size is set to 16 for Facial Landmarks Estimation network [ INFO ] Checking Facial Landmarks Estimation network inputs [ INFO ] Checking Facial Landmarks Estimation network outputs [ INFO ] Loading Facial Landmarks Estimation model to the MYRIAD plugin [ INFO ] Loading network files for Antispoofing Classifier network [ INFO ] Batch size is set to 16 for Antispoofing Classifier network [ INFO ] Checking Antispoofing Classifier network inputs [ INFO ] Checking Antispoofing Classifier network outputs [ INFO ] Loading Antispoofing Classifier model to the MYRIAD plugin To close the application, press 'CTRL+C' here or switch to the output window and press Q or Esc [ INFO ] Number of processed frames: 24 [ INFO ] Total image throughput: 2.34991 fps E: [global] [ 364295] [interactive_fac] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 364295] [interactive_fac] XLinkResetRemote:257 can't wait dispatcherClosedSem [ INFO ] Execution successful
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ |
Number of processed frames | 218 | 467 | 379 | 13 | 86 | 41 | 24 |
Total image throughput (fps) | 19.2 | 16.5 | 17.6 | 2.40 | 17.4 | 4.48 | 2.35 |
$ cd ~/run_app/ $ ./_gaze_estimation_demo.sh [gaze_estimation_demo.sh] 'gaze_estimation_demo' Run !! InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Parsing input parameters [ INFO ] Loading device CPU [ INFO ] CPU MKLDNNPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Execution successful・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_gaze_estimation_demo_16.sh [gaze_estimation_demo_16.sh] 'gaze_estimation_demo (NCS2)' Run !! InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Parsing input parameters [ INFO ] Loading device MYRIAD [ INFO ] MYRIAD myriadPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Loading device MYRIAD [ INFO ] MYRIAD myriadPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Loading device MYRIAD [ INFO ] MYRIAD myriadPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Loading device MYRIAD [ INFO ] MYRIAD myriadPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Loading device MYRIAD [ INFO ] MYRIAD myriadPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 E: [global] [ 510215] [gaze_estimation] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 510215] [gaze_estimation] XLinkResetRemote:257 can't wait dispatcherClosedSem [ INFO ] Execution successful
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ |
Overeli (fps) | 40 | 32 | 62 | 28 | 110 | 23 | 19 |
Interface (fps) | 46 | 41 | 75 | 32 | 202 | 35 | 26 |
$ cd ~/run_app/ $ ./_security_barrier_camera_demo.sh [security_barrier_camera_demo.sh] 'security_barrier_camera_demo' Run !! [ INFO ] InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Files were added: 1 [ INFO ] /home/mizutu/Videos/car-detection.mp4 [ INFO ] Loading device CPU [ INFO ] CPU MKLDNNPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Loading detection model to the CPU plugin [ INFO ] Loading Vehicle Attribs model to the CPU plugin [ INFO ] Loading Licence Plate Recognition (LPR) model to the CPU plugin [ INFO ] Number of InferRequests: 1 (detection), 3 (classification), 3 (recognition) [ INFO ] 1 streams for CPU [ INFO ] Display resolution: 1920x1080 [ INFO ] Number of allocated frames: 3 [ INFO ] Resizable input with support of ROI crop and auto resize is disabled 46.7FPS for (375 / 1) frames Detection InferRequests usage: 100.0% [ INFO ] Execution successful・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_security_barrier_camera_demo_16.sh [security_barrier_camera_demo_16.sh] 'security_barrier_camera_demo (NCS2)' Run !! [ INFO ] InferenceEngine: API version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Files were added: 1 [ INFO ] /home/mizutu/Videos/car-detection.mp4 [ INFO ] Loading device MYRIAD [ INFO ] MYRIAD myriadPlugin version ......... 2.1 Build ........... 2021.3.0-2787-60059f2c755-releases/2021/3 [ INFO ] Loading detection model to the MYRIAD plugin [ INFO ] Loading Vehicle Attribs model to the MYRIAD plugin [ INFO ] Loading Licence Plate Recognition (LPR) model to the MYRIAD plugin [ INFO ] Number of InferRequests: 1 (detection), 3 (classification), 3 (recognition) [ INFO ] Display resolution: 1920x1080 [ INFO ] Number of allocated frames: 3 [ INFO ] Resizable input with support of ROI crop and auto resize is disabled 31.8FPS for (297 / 1) frames Detection InferRequests usage: 100.0% E: [global] [ 646457] [security_barrie] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 646457] [security_barrie] XLinkResetRemote:257 can't wait dispatcherClosedSem [ INFO ] Execution successful
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ |
fps | 157.7 | 161.4 | 128.9 | 35.3 | 164.5 | 46.7 | 31.8 |
$ cd ~/run_app/ $ ./_image_inpainting_demo.sh [image_inpainting_demo.sh] 'image_inpainting_demo' Run !!・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_image_inpainting_demo_16.sh [image_inpainting_demo_16.sh] 'image_inpainting_demo (NCS2)' Run !! E: [global] [ 881231] [python3] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 881231] [python3] XLinkResetRemote:257 can't wait dispatcherClosedSem
$ cd ~/run_app/ $ ./_colorization_demo.sh [colorization_demo.sh] 'colorization_demo' Run !!・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_colorization_demo_16.sh [colorization_demo_16.sh] 'colorization_demo (NCS2)' Run !! E: [global] [ 29835] [python3] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 29835] [python3] XLinkResetRemote:257 can't wait dispatcherClosedSem
$ cd ~/run_app/ $ ./_deblurring_demo.sh [deblurring_demo.sh] 'deblurring_demo' Run !! [ INFO ] Initializing Inference Engine... [ INFO ] Loading network... [ INFO ] Reading network from IR... [ INFO ] Loading network to CPU plugin... [ INFO ] Starting inference... To close the application, press 'CTRL+C' here or switch to the output window and press ESC key Latency: 629.6 ms FPS: 1.6・⑦ Core™ i3-1115G4 + NCS2
$ cd ~/run_app/ $ ./_deblurring_demo_16.sh [deblurring_demo_16.sh] 'deblurring_demo (NCS2)' Run !! [ INFO ] Initializing Inference Engine... [ INFO ] Loading network... [ INFO ] Reading network from IR... [ INFO ] Loading network to MYRIAD plugin... [ INFO ] Starting inference... To close the application, press 'CTRL+C' here or switch to the output window and press ESC key Latency: 592.9 ms FPS: 1.7 E: [global] [ 118055] [python3] XLink_sem_wait:94 XLink_sem_inc(sem) method call failed with an error: -1 E: [global] [ 118055] [python3] XLinkResetRemote:257 can't wait dispatcherClosedSem
項目 | ① | ② | ③ | ④ | ⑤ | ⑥ | ⑦ |
Latency(ms) | 160.0 | 182.9 | 164.3 | 589.9 | 213.4 | 629.6 | 592.9 |
fps | 5.9 | 5.1 | 5.8 | 1.6 | 4,5 | 1.6 | 1.7 |
使用可能なすべての推論エンジン デバイスを照会し、サポートされているメトリックと既定の構成値を出力する。
$ cd ~/run_app/ $ ./_hello_query_device.sh [hello_query_device.sh] 'hello_query_device' Run !! Available devices: [E:] [BSL] found 0 ioexpander device Device: CPU Metrics: AVAILABLE_DEVICES: SUPPORTED_METRICS: AVAILABLE_DEVICES, SUPPORTED_METRICS, FULL_DEVICE_NAME, OPTIMIZATION_CAPABILITIES, SUPPORTED_CONFIG_KEYS, RANGE_FOR_ASYNC_INFER_REQUESTS, RANGE_FOR_STREAMS FULL_DEVICE_NAME: 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz OPTIMIZATION_CAPABILITIES: FP32, FP16, INT8, BIN SUPPORTED_CONFIG_KEYS: CPU_BIND_THREAD, CPU_THREADS_NUM, CPU_THROUGHPUT_STREAMS, DUMP_EXEC_GRAPH_AS_DOT, DYN_BATCH_ENABLED, DYN_BATCH_LIMIT, ENFORCE_BF16, EXCLUSIVE_ASYNC_REQUESTS, PERF_COUNT RANGE_FOR_ASYNC_INFER_REQUESTS: 1, 1, 1 RANGE_FOR_STREAMS: 1, 1 Default values for device configuration keys: CPU_BIND_THREAD: YES CPU_THREADS_NUM: 0 CPU_THROUGHPUT_STREAMS: 1 DUMP_EXEC_GRAPH_AS_DOT: DYN_BATCH_ENABLED: NO DYN_BATCH_LIMIT: 0 ENFORCE_BF16: NO EXCLUSIVE_ASYNC_REQUESTS: NO PERF_COUNT: NO Device: GNA Metrics: GNA_LIBRARY_FULL_VERSION: 2.0.0.1047 FULL_DEVICE_NAME: GNA_SW OPTIMAL_NUMBER_OF_INFER_REQUESTS: 1 SUPPORTED_CONFIG_KEYS: EXCLUSIVE_ASYNC_REQUESTS, GNA_COMPACT_MODE, GNA_DEVICE_MODE, GNA_FIRMWARE_MODEL_IMAGE, GNA_FIRMWARE_MODEL_IMAGE_GENERATION, GNA_LIB_N_THREADS, GNA_PRECISION, GNA_PWL_UNIFORM_DESIGN, GNA_SCALE_FACTOR, GNA_SCALE_FACTOR_0, PERF_COUNT, SINGLE_THREAD SUPPORTED_METRICS: GNA_LIBRARY_FULL_VERSION, FULL_DEVICE_NAME, OPTIMAL_NUMBER_OF_INFER_REQUESTS, SUPPORTED_CONFIG_KEYS, SUPPORTED_METRICS, AVAILABLE_DEVICES AVAILABLE_DEVICES: GNA_SW Default values for device configuration keys: EXCLUSIVE_ASYNC_REQUESTS: NO GNA_COMPACT_MODE: NO GNA_DEVICE_MODE: GNA_SW_EXACT GNA_FIRMWARE_MODEL_IMAGE: GNA_FIRMWARE_MODEL_IMAGE_GENERATION: GNA_LIB_N_THREADS: 1 GNA_PRECISION: I16 GNA_PWL_UNIFORM_DESIGN: NO GNA_SCALE_FACTOR: 1.000000 GNA_SCALE_FACTOR_0: 1.000000 PERF_COUNT: NO SINGLE_THREAD: YES Device: MYRIAD Metrics: DEVICE_THERMAL: UNSUPPORTED TYPE OPTIMIZATION_CAPABILITIES: FP16 RANGE_FOR_ASYNC_INFER_REQUESTS: 3, 6, 1 SUPPORTED_METRICS: DEVICE_THERMAL, OPTIMIZATION_CAPABILITIES, RANGE_FOR_ASYNC_INFER_REQUESTS, SUPPORTED_METRICS, SUPPORTED_CONFIG_KEYS, FULL_DEVICE_NAME, AVAILABLE_DEVICES SUPPORTED_CONFIG_KEYS: DEVICE_ID, EXCLUSIVE_ASYNC_REQUESTS, LOG_LEVEL, VPU_MYRIAD_FORCE_RESET, VPU_MYRIAD_PLATFORM, VPU_CUSTOM_LAYERS, PERF_COUNT, VPU_PRINT_RECEIVE_TENSOR_TIME, CONFIG_FILE, VPU_HW_STAGES_OPTIMIZATION, MYRIAD_THROUGHPUT_STREAMS, MYRIAD_ENABLE_FORCE_RESET, MYRIAD_ENABLE_RECEIVING_TENSOR_TIME, MYRIAD_CUSTOM_LAYERS, MYRIAD_ENABLE_HW_ACCELERATION FULL_DEVICE_NAME: Intel Movidius Myriad X VPU AVAILABLE_DEVICES: 1.3-ma2480 Default values for device configuration keys: DEVICE_ID: EXCLUSIVE_ASYNC_REQUESTS: NO LOG_LEVEL: LOG_NONE VPU_MYRIAD_FORCE_RESET: NO VPU_MYRIAD_PLATFORM: VPU_CUSTOM_LAYERS: PERF_COUNT: NO VPU_PRINT_RECEIVE_TENSOR_TIME: NO CONFIG_FILE: VPU_HW_STAGES_OPTIMIZATION: YES MYRIAD_THROUGHPUT_STREAMS: -1 MYRIAD_ENABLE_FORCE_RESET: NO MYRIAD_ENABLE_RECEIVING_TENSOR_TIME: NO MYRIAD_CUSTOM_LAYERS: MYRIAD_ENABLE_HW_ACCELERATION: YES