How OpenAI's Sora model is DIFFERENT #ai #openai

if you haven't seen it Sora is the text video model from open Ai and this if you weren't studying it would look like a major feature of film the traditional approach for rendering video is you create three-dimensional objects and then you have a rendering engine that renders those objects and then you have a system that defines where the camera goes and that's how you get the visual that you use to generate a 2d movie like this this doesn't do that this was a train model so how would you train a model to do this without having a 3D space the compute necessary to Define each of those objects place them in 3D space is practically impossible today my

guess is that open AI used a tool like Unreal Engine 5 and generated tons and tons of video content tagged it labeled it and we're then able to use that to train this model that can for whatever reason that we don't understand do this you're referring to synthetic training data exactly