Counting 3,834 Big Data & Machine Learning Frameworks, Toolsets, and Examples...
Suggestion? Feedback? Tweet @stkim1

Author
Contributors

AI4Animation - for javascript & three.js

Description

This project is a port of the original AI4Animation project, for use with three.js on the web. It explores the possibilities of using artifical intelligence to generate realtime character animations. This is very powerful as it allows for an unlimited number of realistic transitions between animation states.

I followed the SIGGRAPH 2018. example for this demo, using the same model weights and corresponding skeleton. After providing the inputs of trajectory points and previous bone positions, the neural network ( written using numjs ) outputs the next set of bone positions and velocities.

If you want to use a different skeleton, you will need to get motion capture data for this skeleton and train a new model, the instructions and tensorflow code for this are in the AI4Animation project here.

Todo Items

  • An example with a human skeleton.
  • Trying a simpler machine learning model to help with the fps.

Discord chat

https://discord.gg/UXypcZV

Live Demo

https://codercat.tk/ai-animation/

Run the demo yourself

Run the following commands:

yarn install
yarn pull // this pulls the model weights hosted on the web
yarn start

Then open http://127.0.0.1:3000 in a web browser.

License

MIT License, Copyright © 2019 Sneha Belkhale

However, if you are using the original dataset for commercial purposes, you should read the copyright information from the original AI4Animation project.