Introducing NeuroSync: Real-Time 60fps Audio-to-Face Animation with Transformer-Based Seq2Seq Neural Networks

Hello, really pleased you are having some positive results!

It’s likely working better due to some frame skipping that happens when I record my screen and run the model + unreal project - more a slow hardware thing than a difference in model performance.

There is a new version coming in the new year with some improvments and I will make sure to go into more detail about how we create the dataset and train the model - it does work for any language too, although the accuracy for lesser known languages is untested at the moment.

I shall keep this updated :slight_smile: