The Future of Facial Animation with AI | Unreal Engine Metahuman

49 thoughts on “The Future of Facial Animation with AI | Unreal Engine Metahuman”

1. my 60s ARkit workflow here: https://youtube.com/shorts/XCImJLD9FA4?feature=share

2. 我也在期待那一天的到来，去释放arkit或者普通摄像头的最高的能力，AiGC的时代终将来临！！

3. Amazing explanation and sharing of knowledge! Insta sub!

4. does it work on mac m1 max ?

5. so awesome of you to share your knowledge. I really like this "sharing knowledge freely = everyone's ultimate success" philosophy. AI is going to help a lot, but it's but there yet for Facial Mocap. ARKit is so hohum, I'm not convinced it's worth all the effort of incorporating into my workflow just for some eye movements and blinks (I am using stylized in house characters so nothing is automatic). I was hoping you would give us your thoughts on Nvidia's Voice2Face, is that a good option front end labor vs. end result? I simply haven't have much success in mapping the face (again, for my characters, but for metahumans I was pretty happy, at least I thought it was better than ARKit for emotion and speech). Thanks again for taking the time to help us out!

6. I have an android, not an iphone. But I'm working on getting an iphone (not to have as a phone but just for facial motion capture). Could you please put together a tutorial at some point on facial motion capture in Unreal Engine 5 please?

7. Ar core supported android phone works here?

8. Me crying in 3DS MAX rip me, honestly i might aswell start some sorta RND for facial tracking for 3ds max, i need courage!!!!

9. For me, a big drawback of ARKit is that certain facial expressions aren't recorded into the blendshapes at all. For example you can hardly do non-symmetric brow up movement (🤨), worried face (😟) and sad face with hanging lower lip. I assume this can be solved by software in the future, but so far I haven't seen much progress in ARKit facial tracking last few years unfortunately.

10. I’d rather it didn’t it’s bad enough without getting it to do that

11. Does it run on an apple m1 chip. I heard that its complicated?

12. 感谢分享，干货中的干货👍

13. What about combine and retarget 3d scanned per frame facial animation and morph animation? Maybe is not good and flexible for unreal but must be better result

14. Hi thanks for this! Can I get your opinion on upcoming image generators? Specifically Bluewillow as they are still in beta testing phase? Are they too late?

15. The ghetto camera rig was like $4k lol!!

16. New sub here looking for good content on unreal for cinematic purposes.

17. 您好，杨老师。我是一名正在学习ue的学生。想请问一下您的lip sync 中，手指涂抹嘴唇那个部分是怎么做的，可以简单帮我指个方向吗。非常感谢

18. top

19. Very interesting. Thanks for sharing. Great video ❤😮😊

20. Nice breakdown of whats out there. Facegood looks like a very solid option for what im looking for

    Also not sure if you have covered Nvidia Audio2Face – its another option with varying results

21. If you have $7600, you can buy r3ds wrap4d and track, which would allow you to have a 4d facial animation solution with your own hardware and have what is the best imo facial animation solution, even if it's time consuming and data intensive but I'm trying to see if I can use arkit depth data for that but I need the software to do that

22. We really need an AI that analyses like 10 minutes of videos of someones face and can use that data to make near-perfect copy of all the emotions of that person in metahumans.

23. if there's someone who looking for lipsync animation for virtual human's speeking here are some alternative ai animation solutions

    speechgraphics is amazing
    OVR is free
    Metahuman SDK Plugin is free

24. Thank you SO SO SO much for this research. I know it was a mountain. I definantly will stick with ARKit and additional post animation where needed.

25. 4:17 Super creepy 😎 Great effect to show a robot freaking out and starting to lose control.

26. 11:09 Respect.

27. What an awesome video!

28. this just got a huge update

29. man….metahuman animator is comming…it use iphone depth sensor. wow.. what a fast

30. 我们是一家来自中国的2D生成3D算法团队，我们提供高精度动作捕捉算法，如果您感兴趣，可以看看我们的产品

31. Dude AI is useless. It's guessing + using more power. And people growling isn't a sellable product in entertainment. Entertainment is s break from that.

32. Now Unreal 5.2 is out. What do you think about Metehuman Animator?

33. Is there any option for android alternative for ARkit

34. Glad I discovered this channel

35. I think having the unreal engine options completely work on a iOS or android device is truly being accessible

36. Excellent, comprehensive, brilliant, thank you

37. this is great info.. thanks for sharing!

38. Hey, have you seen Unreal Engine's 5.2 Realtime Facial Tracking Animation Demo? Are you using the same tech/approach in the video?

39. Really great content. Thanks for sharing.

40. Do those metahumans' skins naturally deform based on collisions like a real human? I'm really wondering if this is happening.

41. What is your opinion of the new Faceware Portal solution?

42. Great video!

    Link to face good?

43. And now MetaHuman Animator is dropping soon. Exciting times!

44. hi good stuff, which program you use to do the machine learning from tracking data to retarget data? and how did you put it back for auto retargeting

45. what software or tool u use to track AI generated faical capture

46. What do you think about the new animation in UE 5.2 they have greatly improved it, please record a video!

47. That video of the robot girl and the girl kissing looks inappropriate honestly

48. I feel like with this ai matching system, the animations look a lot more emotional and believable!

49. Give alternative we dont have i phone

Comments are closed.