AI Character Acting and Relighting Is Crazy Good

Check out the Creative Video Upscaler Video Here: https://youtu.be/5mwKcBPlfVM

This is basically like facial motion capture for 3D characters but with basically already "rendered" images. Super interesting

Basically a “lite” version of Hollywood mocap feature can be available for the public to use soon. Will greatly help with my current ongoing projects. Neat!

I find it astonishing how just two years ago, I was writing code to coax an AI model into producing what I called 'trippy,' distorted fever dream visuals. Witnessing its evolution since then is both awe-inspiring and unsettling hahah. I find myself repeating the matra, "I can't wait to see where it will be in a year"

So we’ll eventually be able to remake entire movies with characters and scenes from different films. Basically complete style transfer, voices included. Weird.

Definitely not blown away by either tech but I love the people who are bringing us ever closer to blown away results 👍 👍 👍

I get so excited when I see that you've uploaded a new video. I always learn something cool and new.

crap, now I may need to rethink my current project/video I'm working on. Thanks a lot, Tim! But seriously, the Live Portrait stuff looks really good. As so many times before, it looks like it could make other options irrelevant.

Thanks for all of your constant, up to date, thorough videos! Props

Your doing great, Tim. This is an exciting time!

We are looking at the mind of the machines and using that mind to take out the thoughts of our own minds because our brains doesn't come with a display integrated.

Always interesting videos Tim. ✌

This would've been perfect for that movie with Kevin Spacey they re-shot

Claude writes some of the best space opera radio drama scripts. I wish there was an ai that can turn them into audio including the sound effects and different voices. This is a snippet of an radio drama script it wrote. Title: "Andromeda's Call" [Dramatic orchestral music swells and fades] NARRATOR: In the year 2157, the starship Odysseus embarked on a mission to explore the outer reaches of the Milky Way. But fate had other plans... [Sound of alarms blaring] CAPTAIN ELENA REYES: All hands, brace for impact! We're caught in the gravitational pull of an uncharted black hole! [Sounds of chaos on the bridge - people shouting, equipment crashing] SCIENCE OFFICER DR. AMIT SHARMA: Captain, our sensors are going haywire! The fabric of space-time is... tearing! [A deafening roar builds to a crescendo, then sudden silence] CAPTAIN REYES: Status report! Where are we? NAVIGATION OFFICER LT. ZARA CHEN: [voice shaking] Captain... according to our star charts... we're in the Andromeda Galaxy. [Gasps and murmurs from the crew] DR. SHARMA: Impossible! We've traveled over 2.5 million light-years in an instant! CAPTAIN REYES: [gravely] Crew of the Odysseus, our mission has changed. We must find a way back to Earth. [Soft beep of the ship's computer] A.I. AURORA: Captain Reyes, based on our current propulsion capabilities, returning to Earth would take approximately 100,000 years. LT. CHEN: [despairingly] We'll never make it back... CAPTAIN REYES: We can't give up hope. There must be advanced civilizations in this galaxy. We'll find a way. [Inspirational music begins to build] NARRATOR: And so began the Odysseus's quest to return home - a journey that would push the boundaries of science, test the limits of human endurance, and uncover the secrets of a strange new galaxy. [Music swells] DR. SHARMA: Captain! I'm detecting an artificial structure on a nearby planet. It appears to be... some kind of ancient alien gateway. CAPTAIN REYES: This could be our ticket home. Prep the landing team. Our greatest adventure is just beginning... [Music reaches a crescendo, then fades] NARRATOR: "Andromeda's Call" - A tale of hope, discovery, and the unquenchable human spirit. Coming soon to your preferred audio drama platform. [End theme music]

bruh i play in amateur movies as an actor, its being really bruh years for artist who dont want direct stuff and more doing it like to draw, write or acting rather typing prompts.

Man I really like what LivePortrait is bringing to the table, great step in the right direction! EMO and Vasa-1, etc. are exciting ( annnd slightly frightening), but LivePortrait's full control is a much needed controlled step in the right direction. Not hating on anyone who wants to re-roll lip-sync until their eyes bleed, but it's easy to undervalue just how vital highly intentional acting is with timing, delivery, pauses, and all the complexities that go into a captivating performance to make you care.   Do you think this likely leads to a solution that auto-composites a LivePortrait 2d facial animation onto a Viggle, Domo type motion capture to wrap a full character performance in a bow?

This is incredible. I have normally kept a hard stance in not using AI because as a creative designer, it feels like losing control of creativity. But, just the other day, I softened my stance. I have a project that will require multiple speaking parts. I don't have a large budget for hiring voice actors. So, I stumbled upon text-to-speech and text-to-speech AI generation that blew my mind. I was able to alter the delivery of the voice over based off of my own vocal audio; and it worked for Male and female voices. My work pipeline instantly expanded! But now this! The mocap translation is incredible. I could find a use for this without surrendering everything to AI.

I have had an app for over 7 years now that’s called Mug Life, that has been able to animate still picture faces with 100 percent custom control, plus you could type in text and make the picture talk.

I truly enjoy this channel

I see so many TikTok’s where people have to label the character that they’re pretending to be with text to make the joke work. It’s gonna be so different when you can actually make it feel like the video is filmed in real life with those people, but use different facial expressions and voices. Great video as always.