A very simple baseline to estimate 2D & 3D SMPL-compatible keypoints from a single color image.

Last update: Dec 05, 2022

Overview

Minimal Body

A very simple baseline to estimate 2D & 3D SMPL-compatible keypoints from a single color image.

The model file is only 51.2 MB and runs at 70fps on a 2080Ti.

Usage

Download the pre-trained model here into model/.
Install the dependencies.
Run python example.py.

The model is trained using the following datasets jointly:

Please also check the license of the listed datasets.

If you find it helpful, please consider citing our related paper:

@InProceedings{Zhou_2021_CVPR,
    author    = {Zhou, Yuxiao and Habermann, Marc and Habibie, Ikhsanul and Tewari, Ayush and Theobalt, Christian and Xu, Feng},
    title     = {Monocular Real-Time Full Body Capture With Inter-Part Correlations},
    booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    month     = {June},
    year      = {2021},
    pages     = {4811-4822}
}

You might also like...

SMPL-X: A new joint 3D model of the human body, face and hands together

SMPL-X: A new joint 3D model of the human body, face and hands together [Paper Page] [Paper] [Supp. Mat.] Table of Contents License Description News I

1k Jan 9, 2023

Solving SMPL/MANO parameters from keypoint coordinates.

Minimal-IK A simple and naive inverse kinematics solver for MANO hand model, SMPL body model, and SMPL-H body+hand model. Briefly, given joint coordin

305 Dec 30, 2022

Accelerated SMPL operation, commonly used in generate 3D human mesh, STAR included.

SMPL2 An enchanced and accelerated SMPL operation which commonly used in 3D human mesh generation. It takes a poses, shapes, cam_trans as inputs, outp

20 Oct 17, 2022

A minimal solution to hand motion capture from a single color camera at over 100fps. Easy to use, plug to run.

Minimal Hand A minimal solution to hand motion capture from a single color camera at over 100fps. Easy to use, plug to run. This project provides the

824 Jan 7, 2023

Learning to Estimate Hidden Motions with Global Motion Aggregation

Learning to Estimate Hidden Motions with Global Motion Aggregation (GMA) This repository contains the source code for our paper: Learning to Estimate

221 Dec 18, 2022

A deep learning network built with TensorFlow and Keras to classify gender and estimate age.

Convolutional Neural Network (CNN). This repository contains a source code of a deep learning network built with TensorFlow and Keras to classify gend

1 Dec 18, 2021

A deep learning network built with TensorFlow and Keras to classify gender and estimate age.

Convolutional Neural Network (CNN). This repository contains a source code of a deep learning network built with TensorFlow and Keras to classify gend

1 Dec 19, 2021

Official Pytorch implementation of "Learning to Estimate Robust 3D Human Mesh from In-the-Wild Crowded Scenes", CVPR 2022

Learning to Estimate Robust 3D Human Mesh from In-the-Wild Crowded Scenes / 3DCrowdNet News 💪 3DCrowdNet achieves the state-of-the-art accuracy on 3D

113 Dec 21, 2022

Simple is not Easy: A Simple Strong Baseline for TextVQA and TextCaps[AAAI2021]

Simple is not Easy: A Simple Strong Baseline for TextVQA and TextCaps Here is the code for ssbassline model. We also provide OCR results/features/mode

51 Nov 18, 2022

Comments

About light-weight human detector

Very interesting model! Since this model takes croped human as input, may I ask if there is any realtime human detector recommend that is light-weight to work with this model together? Thank you~

opened by Garfield-kh 2
About the whole model ?

Hey, it is a very great work. By the way, is there any plan for releasing the whole model? What's more, is there any plan for releasing the training code?

opened by maitetsu 2

Releases(v1)

v1(Nov 19, 2021)

The original version.
Source code(tar.gz)
Source code(zip)
minimal_body_v1.pth(51.22 MB)

Owner

Yuxiao Zhou

Good luck, have fun.

GitHub Repository

HIVE: Evaluating the Human Interpretability of Visual Explanations

HIVE: Evaluating the Human Interpretability of Visual Explanations Project Page | Paper This repo provides the code for HIVE, a human evaluation frame

16 Dec 13, 2022

QHack—the quantum machine learning hackathon

Official repo for QHack—the quantum machine learning hackathon

72 Dec 21, 2022

Source code for the Paper: CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraints}

CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraints Installation Run pipenv install (at your own risk with --skip-lo

65 Dec 27, 2022

This is a classifier which basically predicts whether there is a gun law in a state or not, depending on various things like murder rates etc.

Gun-Laws-Classifier This is a classifier which basically predicts whether there is a gun law in a state or not, depending on various things like murde

1 Jan 20, 2022

B-cos Networks: Attention is All we Need for Interpretability

Convolutional Dynamic Alignment Networks for Interpretable Classifications M. Böhle, M. Fritz, B. Schiele. B-cos Networks: Alignment is All we Need fo

58 Dec 23, 2022

Code for "Long-tailed Distribution Adaptation"

Long-tailed Distribution Adaptation (Accepted in ACM MM2021) This project is built upon BBN. Installation pip install -r requirements.txt Usage Traini

10 May 18, 2022

CVPR 2021 Official Pytorch Code for UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training

UC2 UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training Mingyang Zhou, Luowei Zhou, Shuohang Wang, Yu Cheng, Linjie Li, Zhou Yu,

28 Dec 30, 2022

Demo code for paper "Learning optical flow from still images", CVPR 2021.

Depthstillation Demo code for "Learning optical flow from still images", CVPR 2021. [Project page] - [Paper] - [Supplementary] This code is provided t

130 Dec 25, 2022

Mouse Brain in the Model Zoo

Deep Neural Mouse Brain Modeling This is the repository for the ongoing deep neural mouse modeling project, an attempt to characterize the representat

15 Aug 22, 2022

Python implementation of the multistate Bennett acceptance ratio (MBAR)

pymbar Python implementation of the multistate Bennett acceptance ratio (MBAR) method for estimating expectations and free energy differences from equ

169 Dec 02, 2022

Code release for SLIP Self-supervision meets Language-Image Pre-training

SLIP: Self-supervision meets Language-Image Pre-training What you can find in this repo: Pre-trained models (with ViT-Small, Base, Large) and code to

621 Dec 31, 2022

Official code repository for the EMNLP 2021 paper

Integrating Visuospatial, Linguistic and Commonsense Structure into Story Visualization PyTorch code for the EMNLP 2021 paper "Integrating Visuospatia

23 Dec 19, 2022

MediaPipeのPythonパッケージのサンプルです。2020/12/11時点でPython実装のある4機能(Hands、Pose、Face Mesh、Holistic)について用意しています。

mediapipe-python-sample MediaPipeのPythonパッケージのサンプルです。 2020/12/11時点でPython実装のある以下4機能について用意しています。 Hands Pose Face Mesh Holistic Requirement mediapipe 0.

217 Dec 12, 2022

Unrolled Generative Adversarial Networks

Unrolled Generative Adversarial Networks Luke Metz, Ben Poole, David Pfau, Jascha Sohl-Dickstein arxiv:1611.02163 This repo contains an example notebo

292 Dec 06, 2022

High-resolution networks and Segmentation Transformer for Semantic Segmentation

High-resolution networks and Segmentation Transformer for Semantic Segmentation Branches This is the implementation for HRNet + OCR. The PyTroch 1.1 v

2.8k Jan 07, 2023

Implementations of orthogonal and semi-orthogonal convolutions in the Fourier domain with applications to adversarial robustness

Orthogonalizing Convolutional Layers with the Cayley Transform This repository contains implementations and source code to reproduce experiments for t

36 Dec 30, 2022

A very simple baseline to estimate 2D & 3D SMPL-compatible keypoints from a single color image.

Related tags

Overview

Minimal Body

Usage

You might also like...

SMPL-X: A new joint 3D model of the human body, face and hands together

Solving SMPL/MANO parameters from keypoint coordinates.

Accelerated SMPL operation, commonly used in generate 3D human mesh, STAR included.

A minimal solution to hand motion capture from a single color camera at over 100fps. Easy to use, plug to run.

Learning to Estimate Hidden Motions with Global Motion Aggregation

A deep learning network built with TensorFlow and Keras to classify gender and estimate age.

A deep learning network built with TensorFlow and Keras to classify gender and estimate age.

Official Pytorch implementation of "Learning to Estimate Robust 3D Human Mesh from In-the-Wild Crowded Scenes", CVPR 2022

Simple is not Easy: A Simple Strong Baseline for TextVQA and TextCaps[AAAI2021]

Comments

About light-weight human detector

About the whole model ?

Releases(v1)

v1(Nov 19, 2021)

Owner

Yuxiao Zhou

HIVE: Evaluating the Human Interpretability of Visual Explanations

QHack—the quantum machine learning hackathon

Source code for the Paper: CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraints}

This is a classifier which basically predicts whether there is a gun law in a state or not, depending on various things like murder rates etc.

B-cos Networks: Attention is All we Need for Interpretability

Code for "Long-tailed Distribution Adaptation"

CVPR 2021 Official Pytorch Code for UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training

Demo code for paper "Learning optical flow from still images", CVPR 2021.

Mouse Brain in the Model Zoo

Python implementation of the multistate Bennett acceptance ratio (MBAR)

Code release for SLIP Self-supervision meets Language-Image Pre-training

Official code repository for the EMNLP 2021 paper

MediaPipeのPythonパッケージのサンプルです。2020/12/11時点でPython実装のある4機能(Hands、Pose、Face Mesh、Holistic)について用意しています。

Unrolled Generative Adversarial Networks

High-resolution networks and Segmentation Transformer for Semantic Segmentation

Implementations of orthogonal and semi-orthogonal convolutions in the Fourier domain with applications to adversarial robustness

Robust Video Matting in PyTorch, TensorFlow, TensorFlow.js, ONNX, CoreML!

Finding all things on-prem Microsoft for password spraying and enumeration.

Intrinsic Image Harmonization

some classic model used to segment the medical images like CT、X-ray and so on