HolisticBarracuda

full

pose_and_face

pose_and_hand

pose_only

face_only

HolisticBarracuda is the Unity Package that simultaneously estimates 33 pose, 21 per-hand, and 468 facial landmarks with a monocular color camera only.

HolisticBarracuda runs the pipeline simular to Mediapipe Holistic on the Unity.

Dependencies

HolisticBarracuda uses the following packages:

• BlazeFaceBarracuda
• FaceLandmarkBarracuda
• IrisBarracuda
• BlazePalmBarracuda
• HandLandmarkBarracuda
• BlazePoseBarracuda

Used source codes

Parts of face and hands implementations used many keijiro's below source codes. Thanks!

• FaceMeshBarracuda
• HandPoseBarracuda

Install

HolisticBarracuda can be installed by adding following sections to your manifest file (Packages/manifest.json).

To the scopedRegistries section:

{
    "name": "Keijiro",
    "url": "https://registry.npmjs.com",
    "scopes": [ "jp.keijiro" ]
},
{
  "name": "creativeikep",
  "url": "https://registry.npmjs.com",
  "scopes": [ "jp.ikep" ]
}

To the dependencies section:

"jp.ikep.mediapipe.holistic": "1.1.0"

Finally, the manifest file looks like below:

{
    "scopedRegistries": [
        {
            "name": "Keijiro",
            "url": "https://registry.npmjs.com",
            "scopes": [ "jp.keijiro" ]
        },
        {
            "name": "creativeikep",
            "url": "https://registry.npmjs.com",
            "scopes": [ "jp.ikep" ]
        }
    ],
    "dependencies": {
        "jp.ikep.mediapipe.holistic": "1.1.0",
        ...
    }
}

Usage Demo

This repository has the demo that inference pose, face and hands landmarks, and visualize landmarks.

Check a Unity scene, scripts and shaders in the "/Assets" directory.

Demo image

Videos for demo was downloaded from pexels.

• https://www.pexels.com/ja-jp/video/5089491/
• https://www.pexels.com/ja-jp/video/4492700/
• https://www.pexels.com/ja-jp/video/8627747/
• https://www.pexels.com/ja-jp/video/2795750/
• https://www.pexels.com/ja-jp/video/6985340/

Author

IKEP

LICENSE

Copyright (c) 2021 IKEP

Apache-2.0