genealeaderboard.github.io
GENEA (Generation and Evaluation of Non-verbal Behaviour for Embodied Agents) Leaderboard is a leaderboard for benchmarking gesture generation models with human evaluation. The GENEA Leaderboard is the evolution of the GENEA challenge, which was held at the GENEA Workshop at ICMI 2020, 2021, 2022, 2023, and 2024.
We standardize the input, output and evaluation process of gesture generation models with human evaluation.
How we evalution in GENEA Leaderboard? We provide a input to teams, and each team's model will generate gestures output in .npy format.
We provide a input to teams, and each team's model will generate gestures output in .npy format.
Then, we convert .npy to video .mp4 and recruit Prolific to start user studies.
Using pairwise comparison, we evaluate the generated gestures with human evaluation
-
The GENEA team is preparing an online leaderboard for benchmarking gesture generation models with human evaluation. This project is the evolution of the GENEA challenge, so stay tuned!
-
If you would like to stay updated on major developments in theleaderboard project, sign up with your e-mail address on this link!
Workshop
Official GENEA Workshop at ICMI 2024
- Results of the GENEA Challenge 2023
- 4th GENEA Workshop website (at ICMI 2023)
- Results of the GENEA Challenge 2022
- 3rd GENEA Workshop website (at ICMI 2022)
- 2nd GENEA Workshop website (at ICMI 2021)
- Results of the GENEA Challenge 2020
- 1st GENEA Workshop and Challenge website (at IVA 2020)
For updates, follow us: GENEA Workshop