AI Video Just Stepped Into the Real World!
Your AI characters can now stand in your actual room, and react to what's in it! Simulon is back: turn a character image into a 3D "neural asset," place it in the real world through your phone's camera, act out the scene with your own camera move, and the app regenerates the take with the character responding to what you do and say. Also: a kitbash into Kling 4.0 and Genie 4, and Alibaba's Apsara slide with Wan, Happy Horse and Happy Shrimp on the board. WHAT'S IN THIS ONE - Simulon, back from 2023 (2.0 shipped October 9, Reality-Aware Rendering October 28): upload a character reference, it builds a 3D neural asset, you place, scale and rotate it in your real space through the phone camera, then generate. Not real time yet: you prompt the action, or shoot your take first and let it render. - Flamethrower Girl, life-size at my bar: my camera move, my location, no world-model hallucination (the ball on the floor is really there). Mini version on the desk, then a jungle-attire run across the bar. - Kitbash 1: the Simulon output into Kling 4.0 video-to-video, location swapped. - Two characters at once: Renfield and Flamethrower Girl play tennis at the park (wonky, but consistent in the space). Then Flamethrower Girl walks Simulon's library tiger through my living room, and the two interact without being asked. - Isn't this just reference-to-video? Mostly, yes (the back end feels Minimax-ish to me, a guess). The difference is blocking your characters on set, run-and-gun. - Reality-Aware Rendering: the characters respond to what you do and say in the take. I poke the tiger and mini Flamethrower Girl with my finger. A mech goes aggro at Astro the cat, who could not care less. - Renfield tends bar and reacts to my voice. The rum keeps disappearing. - Roadmap: Simulon tells me voices and assignable personalities are coming. Their own demo shows a character taking spoken direction. - Kitbash 2: a Simulon output into Genie 4, then a walk through the back rooms of my own house. - Pricing: free to try on iPhone (100 starter credits, library characters only). Plus is $14.99 a month (your own characters from images or words, commercial use for individuals); Pro is $39.99 (3x the usage, business use). Android is next; Simulon tells me it's waiting on Google. - Alibaba's Apsara slide: Wan, Happy Horse and Happy Shrimp on the model-family board. [Tim — "November" isn't on the slide; keep it only with a source, linked below.] SPONSOR This video is sponsored by Artlist. 3D Model is now its own category on Artlist, next to where you already generate images, video, voiceover and music: a text prompt or a photo goes in, a production-ready 3D asset comes out in about a minute, with Hunyuan 3D, Tripo H3.1 and Meshy v7 in the lineup. Once it's a real 3D object there's no wrong angle anymore, and the video model finally has a reference that doesn't drift. ► Try the new 3D models over on Artlist, who were kind enough to sponsor today's video: https://artlist.io/artlist-70446/?artlist_aid=TheoreticallyMedia_4024&utm_source=affiliate_p&utm_medium=TheoreticallyMedia_4024&utm_campaign=TheoreticallyMedia_4024 LINKS Simulon on the App Store: https://apps.apple.com/us/app/simulon/id6670765943 Simulon: https://simulon.com/ Reality-Aware Rendering, announced by Divesh Naidoo: https://x.com/diveshnaidoo/status/2115477721455214623 Simulon's caveman short film: https://x.com/Simulon/status/2115519228564693170 What was actually filmed: https://x.com/diveshnaidoo/status/2115540443580481759 Genie 4 hands-on: https://www.youtube.com/watch?v=kJgYSiIZMb8 Kling 4 video: https://www.youtube.com/watch?v=U9tFP81PSbQ Dead Sea (Renfield's film): https://www.youtube.com/watch?v=o_90Vd8rAwI Alibaba's Apsara slide: [Tim — the post you took the slide from] Newsletter: https://theoreticallymedia.com/newsletter/ CHAPTERS 00:00 Can your AI characters live in the real world? 00:14 Simulon is back 00:48 Mini Flamethrower Girl on my desk 01:09 How it works: phone camera, character ref to 3D, place it 01:47 Life-size Flamethrower Girl at the bar 02:33 Your camera move, your location 03:08 Kitbash: Simulon to Kling 4.0 video-to-video 03:30 Two characters: Renfield and Flamethrower Girl play tennis 04:20 From Dead Sea to the tennis court 04:38 Flamethrower Girl, tiger trainer 05:21 Artlist 3D (sponsor) 07:36 Isn't this just reference-to-video? 08:19 Reality-Aware Rendering: poke the tiger 09:07 Mech vs. Astro the cat 10:00 Renfield tends bar (he hears my voice) 10:50 Roadmap: voices, personalities, spoken direction 11:58 Simulon's caveman short film 12:11 Kitbash: Simulon to Genie 4 13:19 Pricing and availability (free on iPhone, Android next) 13:49 Wan and Happy Horse: Alibaba's Apsara slide 14:08 Wrap #AIVideo #AINews #Simulon #AR #FlamethrowerGirl #Genie4 #Kling4 #Artlist
