Skip to content

Commit 544804b

Browse files
authored
[pose-detection]Add model quality table for BlazePose. (#741)
PROCESS
1 parent 4f34402 commit 544804b

File tree

2 files changed

+28
-0
lines changed

2 files changed

+28
-0
lines changed

pose-detection/src/blazepose_mediapipe/README.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -17,6 +17,7 @@ Please try our our live [demo](https://storage.googleapis.com/tfjs-models/demos/
1717
2. [Usage](#usage)
1818
3. [Performance](#performance)
1919
4. [Bundle Size](#bundle-size)
20+
5. [Model Quality](#model-quality)
2021

2122
## Installation
2223

@@ -140,3 +141,16 @@ There is a difference of how things are loaded between the two runtimes. For the
140141
| Lite model | 10.41MB | 1.91s |
141142
| Full model | 13.8MB | 1.91s |
142143
| Heavy model | 34.7MB | 4.82s |
144+
145+
## Model Quality
146+
To evaluate the quality of our models against other well-performing publicly available solutions, we use three different validation datasets, representing different verticals: Yoga, Dance and HIIT. Each image contains only a single person located 2-4 meters from the camera. To be consistent with other solutions, we perform evaluation only for 17 keypoints from [COCO topology](https://cocodataset.org/#keypoints-2020). For more detail, see the [article](https://google.github.io/mediapipe/solutions/pose#pose-estimation-quality).
147+
148+
| Method | Yoga<br>[mAP](https://cocodataset.org/#keypoints-eval) | Yoga<br>[[email protected]](https://github.com/cbsudux/Human-Pose-Estimation-101#percentage-of-correct-key-points---pck) | Dance<br>[mAP](https://cocodataset.org/#keypoints-eval) | Dance<br>[[email protected]](https://github.com/cbsudux/Human-Pose-Estimation-101#percentage-of-correct-key-points---pck) | HIIT<br>[mAP](https://cocodataset.org/#keypoints-eval) | HIIT<br>[[email protected]](https://github.com/cbsudux/Human-Pose-Estimation-101#percentage-of-correct-key-points---pck) |
149+
| --- | --- | --- | --- | --- | --- | --- |
150+
| BlazePose.Heavy | 68.1 | 96.4 | 73.0 | 97.2 | 74.0 | 97.5 |
151+
| BlazePose.Full | 62.6 | 95.5 | 67.4 | 96.3 | 68.0 | 95.7 |
152+
| BlazePose.Lite | 45.0 | 90.2 | 53.6 | 92.5 | 53.8 | 93.5 |
153+
| [AlphaPose.ResNet50](https://github.com/MVIG-SJTU/AlphaPose) | 63.4 | 96.0 | 57.8 | 95.5 | 63.4 | 96.0 |
154+
| [Apple.Vision](https://developer.apple.com/documentation/vision/detecting_human_body_poses_in_images) | 32.8 | 82.7 | 36.4 | 91.4 | 44.5 | 88.6 |
155+
156+
![Quality Chart](https://google.github.io/mediapipe/images/mobile/pose_tracking_pck_chart.png)

pose-detection/src/blazepose_tfjs/README.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,7 @@ In the runtime-backend dropdown, choose 'tfjs-webgl'.
1919
2. [Usage](#usage)
2020
3. [Performance](#performance)
2121
4. [Bundle Size](#bundle-size)
22+
5. [Model Quality](#model-quality)
2223

2324
## Installation
2425

@@ -157,3 +158,16 @@ There is a difference of how things are loaded between the two runtimes. For the
157158
| Lite model | 10.41MB | 1.91s |
158159
| Full model | 13.8MB | 1.91s |
159160
| Heavy model | 34.7MB | 4.82s |
161+
162+
## Model Quality
163+
To evaluate the quality of our models against other well-performing publicly available solutions, we use three different validation datasets, representing different verticals: Yoga, Dance and HIIT. Each image contains only a single person located 2-4 meters from the camera. To be consistent with other solutions, we perform evaluation only for 17 keypoints from [COCO topology](https://cocodataset.org/#keypoints-2020). For more detail, see the [article](https://google.github.io/mediapipe/solutions/pose#pose-estimation-quality).
164+
165+
| Method | Yoga<br>[mAP](https://cocodataset.org/#keypoints-eval) | Yoga<br>[[email protected]](https://github.com/cbsudux/Human-Pose-Estimation-101#percentage-of-correct-key-points---pck) | Dance<br>[mAP](https://cocodataset.org/#keypoints-eval) | Dance<br>[[email protected]](https://github.com/cbsudux/Human-Pose-Estimation-101#percentage-of-correct-key-points---pck) | HIIT<br>[mAP](https://cocodataset.org/#keypoints-eval) | HIIT<br>[[email protected]](https://github.com/cbsudux/Human-Pose-Estimation-101#percentage-of-correct-key-points---pck) |
166+
| --- | --- | --- | --- | --- | --- | --- |
167+
| BlazePose.Heavy | 68.1 | 96.4 | 73.0 | 97.2 | 74.0 | 97.5 |
168+
| BlazePose.Full | 62.6 | 95.5 | 67.4 | 96.3 | 68.0 | 95.7 |
169+
| BlazePose.Lite | 45.0 | 90.2 | 53.6 | 92.5 | 53.8 | 93.5 |
170+
| [AlphaPose.ResNet50](https://github.com/MVIG-SJTU/AlphaPose) | 63.4 | 96.0 | 57.8 | 95.5 | 63.4 | 96.0 |
171+
| [Apple.Vision](https://developer.apple.com/documentation/vision/detecting_human_body_poses_in_images) | 32.8 | 82.7 | 36.4 | 91.4 | 44.5 | 88.6 |
172+
173+
![Quality Chart](https://google.github.io/mediapipe/images/mobile/pose_tracking_pck_chart.png)

0 commit comments

Comments
 (0)