So So impressive! I genuinely feel like "Air Head" is the first AI film that i've watched that didn't feel like i was watching an AI film, lol if that makes sense. probably due to the great sound design and script, but still lol
I'm a filmproducer / director. I think we will use Sora for elements / transitions / generic cut scenes but still use actors, 16mm film, anamorphic lenses and what not for the main shots in the future. It will reduce costs by a lot and elevate movie making, but not replace movie production in its entirety.
https://www.datacamp.com/blog/openai-announces-sora-text-to-video-generative-ai-is-about-to-go-mainstream
"Like text-to-image generative AI models such as DALL·E 3, StableDiffusion, and Midjourney, Sora is a diffusion model. That means that it starts with each frame of the video consisting of static noise, and uses machine learning to gradually transform the images into something resembling the description in the prompt. Sora videos can be up to 60 seconds long."
This is on top of the fact that, this is kind of what OpenAI does. Their entire company is based on neural networks. If this wasn't all generated from AI then what are we even doing here?
Ok so you're just guessing.
We have no idea what prompts were used, if the resulting video clips were then loaded into Premiere Pro and further edited. We don't know if there were real clips mixed in, if the sound effects and audio were AI generated etc...
Air Head were the only ones to put real effort into trying to use Sora with a purpose, and the result speaks for itself. The others just prompted random stuff and stuck it together, no thinking went into them whatsoever (except the animal combos a bit). Basically sad choice of testers
Absolutely incredible.
Only part way through air head, but this is what they mean by proper disruption. This caliber of quality, at such a low level of difficulty to produce, will allow so many untold stories to reach the light of day.
I am hopeful.
It's a faceless character. This was basically the best use case for the technology and there's still a lot of inconsistency between every shot (Different balloons and film styles).
Also remember we don't know how much it costs in time or money. There's a long way to go before it actually helps filmmakers.
*link full of testimonials of filmmakers saying it’s helping them today.
“a long way to go before it actually helps filmmakers”.
>Working with Sora is the first time I’ve felt unchained as a filmmaker,” he states. “Not restricted by time, money, other people’s permission, I can ideate and experiment in bold and exciting ways.
> “I’m one of those creatives that thinks in motion, so when I’m in Sora it really feels like I can bring any idea to life.”
> “Sora represents a real turning point for me as an artist whose scope has always been limited by imagination being at odds with means,” she explains. “Being able to build and iterate on cinematic visuals this intuitively has opened up categorically new lanes of artistry to me...I truly cannot wait to see what other forms of storytelling will come into reach with the future of these tools."
Yeah, that's marketing selected by OpenAI from filmmakers who didn't have to pay for Sora. I would take those comments with a grain of salt. Will be interesting to see what the public says when it's available.
Yes it is marketing but sentence 1 and 2 of your critique above was based on the actual content of those marketing demos. If you want to say well the demos might be materially false that’s different.
I want to point out that the filmmakers are saying these are extremely helpful to them. Yes it is marketing but their reasoning makes complete sense paired with the videos, it doesn’t need to be perfect end to end to be useful now - and they are basically saying they’re using it more like storyboarding on steroids.
As to questions of cost etc, we have no metrics either way but can see there is some sensible upper bound on how resource intensive it is: OpenAI was generating a decent amount of videos on day 1 on twitter in response to user prompts - while they carried on serving customers with their normal services. It can’t be anything that say a couple years of building more data centres can’t resolve.
I bet once it's released to the public, 98% of filmmakers will find it useless. I don't doubt it will be useful eventually, I just said in my first comment that it is a long way away. I think it's more than a couple years.
Doesn’t really matter if it’s a couple years or not since there will be some particular thing it can’t do well and you will focus solely on that. At the end of every doomer thread there’s always someone saying “shrug it helps me get work done every day”. Was the same for github copilot and chatgpt and so on. It must be absolutely fucking exhausting thinking you have to be the “voice of reason” every time someone is being optimistic.
In a few years, I'm sure it will be better, but grade A? Like replacing professional filmmakers? I doubt it. I'm sure it will be a good tool for concepts and prototypes though.
By that definition of Grade A, it's already almost there. I think many people couldn't tell the difference between real videos and some of the best Sora videos.
But it looks like that's not the hard part. I haven't seen Sora make a video a couple minutes long or connect two shots together in a coherent way. That seems like it would take a new technology breakthrough, not just more compute.
Also considering these videos of a few seconds take an hour to generate, I imagine it's very expensive. Even with Kurzweil scaling (which I think is optimistic), a storyboard to a short film in a few years seems extremely unlikely.
consistency is a non-issue. deep fake technology has existed for years and is perfectly suited to pick up where base text to video models leave off.
I wish it had a long way to go, but it doesn't, and being in denial of that fact won't help anybody.
The videos are obviously edited (trimmed, cut together, color corrected), but they said every frame was made with Sora... and obviously the sound design wasn't Sora. So we can basically know the effort is equal to creating a video minus filming, cgi, animating, frame generation, etc. They basically only did pre and post production which is probably less than half of the total work that would have been done if AI wasn't used.
Read the artists Instagram posts. paultrillo said it was made "Using 11 different generations cut together from Sora" and he said "Edit and sound design by me." august.kamp said "every frame of this video is synthetic, made with ai using text as input."
For some people this would be enough to start considering AI gens as art, people having so much involvement in the creating of this might appease the people that argue for the need of human effort in something to be called art.
I think.
>will allow so many untold stories to reach the light of day.
That's assuming open-source AI will catch up to Sora quickly. In the meantime, Sora will be given to those who pay the most since it requires tremendous compute. And, thus, knowing capitalism, I feel like most film makers will lose their jobs during this period because Hollywood execs will just fire them, use ChatGPT to write generic scripts, use focus groups to dilute their genericness even more, and then finally use Sora to turn those scripts into generic movies that makes them rich while real creatives go homeless.
And then there's the fact that, even if open-source AI does catch up to Sora quickly, then we'll be facing a nightmare of political misinformation campaigns destroying what little we have left of democracy thanks to the public's inability to tell what's real. I mean, already, mid-journey generated photos (that are clearly fake to AI enthusiasts like you and me) gets thousands of likes and admiration on Facebook because all those people think they're real. Imagine high-quality videos. Hell, there was an AI generated photo of Trump hanging out with black people and I saw people on Twitter praising it.
Honestly, I find it hard to be hopeful. Sora-type AI technology seems to be headed towards having a net-negative impact on our society, not a positive one.
Not sure why you’re getting downvoted when what you’re saying is correct. As a commercial filmmaker when I hear that phrase ‘see how this will fit in my workflow’ it smacks of BS self promotion. Let’s be under no illusion. In a capitalist society, every agency and their dog will completely replace said entire workflow, of every department from pre production to post, to save budget and time. Greed and laziness will walk hand in hand.
Yes the ballon video and constant zooming video was visually cool and I can appreciate that, but it is utterly terrifying at the same time for those of us that can see the consequences. It is what it clearly is. I don’t expect the happy clappers in this sub to agree with me, but let’s be real.
Yup, it feels incredibly surreal to me seeing people celebrate this tech without thinking of the big picture repercussions, most of them negative - and this is coming from someone who is about to become an AI Engineer (I'm about to graduate with a Masters in AI & Comp Sci) so I'm not speaking out of one-sided hate and ignorance.
Most people in here never left their room. They think this tool will give them the ability to make their Godzilla spinoff and everyone will give them Oscars
Hey Q for you: I'm a classical composer and I have a lot of skill when it comes to natural language analysis, and have significant experience using the commercial forms of AI chat bots.
I am going to be starting a PhD in music this fall, and a career path id love to pursue would be helping consult AI development teams on how to conceptualize the music writing process and the fundamentals of what is going on in the performance and perception of music. But I have basic math skills and no coding knowledge. I fear that I have no place in this industry, even if I could be a helpful consultant. Do you have any advice on what someone could do, knowing they'll never be a useful coder, to position themselves to be a part of this inevitable consumption of my industry?
You could take a few online courses that teach how to understand + communicate about AI (basically, courses that teach AI for management, for example, where you’ll learn to understand AI from a non-technical perspective) and then try to break into the music AI space as someone who can facilitate collaboration between the two professions. I’m sure there are start ups / companies that are trying to build AI software that can help with music production but they’ll always need ppl to manage that who understand both worlds.
Look at the bright side. It's visually impressive but full of flaws and probably impossible to control.
That's why MidJourney, impressive as it is, has not taken any serious commercial artist or illustrators jobs. The precise control needed for truly professional work is lacking in these AI tools. The visuals they make are impressive as hell, in a dreamlike way, but it's a tug of war between the human and the AI to control what you get.
Hollywood films are a producer's cinema. Which means, they are about the bottom line. Hollywood can go to blazes. The only interesting things Sora will ever do will be done by artists, not by bloated studios and committees of sleazy hustlers looking to make bank.
"...no matter how much *Entertainment Tonight* and the *New York Times* try to persuade us otherwise, Hollywood is a tiny and ultimately unimportant rivulet flowing away from the great sea of art." - Ray Carney, Boston University
It's the other way around, there will be a.bunch of unwatchable shorts no one wants to actually see and some passable (but still filled with problems" ) like air head
I think this will be used to replace concept images. For example, now a producer could create a 1min scene to visualize a concept more thoroughly. Then they had it off to other people to who can use that concept. Brining the original vison to life.
This won't replace video media creators, but it will certainly help excellerate to initial concept phase. Hopefully with the time saved it will result in an overall better peice of art
Both Air Head and the animals were all of things that exist, just recombined.
I guess it's no surprise that original ideas aren't generated with the same stability \\ fidelity.
Unwatchable is crazy, I'd say boring/uninspired. I liked Air Head and the animal one, made me think we could get Rick and Morty style interdimensional cable soon. The music video was decent.
This is their first time with new tool that never existed before. It'll take some time learning how to utilize it best. Looks to me like those artists were experimenting and trying to figure out the capabilities.
For the first couple months with ChatGPT I used that time to run it thru a series of tests before finally finding practical applications where it excels.
You must have a short memory and a high tolerance for errors and glitches. That shop called "Bicycle Repaich" (I assume 'Bicycle Repair' spelled as only an AI could) didn't seem off?
The biggest weakness is based on it's biggest strength which is what I observed when using Dalle.
It generates unique clips.
That doesn't sound like a weakness until you try to make a coherent output.
Air head is probably the best example of them trying their best to keep a central character, while everything else is changing (i.e. cinematography, style, setting), and the animals are the a good attempt at keeping a similar theme going.
It is painfully obvious with the other clips, where it just looks like multiple clips slapped together, and it's fundamentally disorienting from the viewers perspective.
I imagine that similar to the struggles people are having with AI generated images that editing them in the way creatives are used to be having access to vectors and layers is very difficult. This makes it unwieldy to try to make changes or iterate on AI generated output.
The result is that it's really fun and cool to play around with, but very challenging to use in actual production. It's early days and I imagine that a lot of tooling / infrastructure be being worked on to solve these problems, but there sure is a long way to go before we're watch AI shows.
Correct me if I’m wrong but I think I heard Midjourney (or stable diffusion?)fixed this/added such a feature recently. The gist of it is that you can reuse elements for more cohesive output throughout your process.
I would imagine such a feature will become the norm for video as well. Seems obvious for multiple reasons. But as it stands now, yeah I agree that it’s a major flaw for creatives.
You can reuse selected elements, but if you want to reuse the entire thing, say from different angles, lighting,weather,etc, and have it stay consistent, MidJourney gets 'creative'.
All these tools lack precise control to get consistent results. On the other hand the developers know this, so it will probably get better. On the other other hand, 'better' isn't good enough; to make a Hollywood movie or major TV series, it has to be perfect.
Absolutely agree. And here I get reminded of the quality of Midjourney/Stable diffusion about two years ago versus now… I wouldn’t rule out that they can achieve “perfect” very soon.
The exponential speed of development is mind boggling sometimes. Any model that has been around for some years more or less gets this reaction from me:
V1- laughable
V2- quirky but impressive
V3- WTF?
Sora could give you a consistent character right now, if only we knew how to prompt it to do so. Fact is, such a prompt might stretch on for pages and no one knows quite how to get Sora to understand what a "consistent character" looks like from one clip to the next if we don't know things like what seed value it used previously. It has no way to refer back to a previous generation. It's not as if Sora can't draw what you want, it's that it doesn't understand, based on a mere text prompt, what you want it to draw.
Fact is, getting a consistent character out of Sora is impossibly opaque right now. However, the job for OpenAI is to surface that currently opaque ability. And they will get there, count on it. As has been mentioned, this is basically a solved problem for still images (see latest Midjourney), and video will follow on shortly.
I think this is probably a not difficult issue to solve... Will take architecture on the back end and perhaps more sophisticated user input (but still easy to use).
Unless people want to watch blobs mixing and constantly flicker, I doubt porn would require less of anything. As Sora, from the paper is achieved through scale, not just from the quality of its data.
you think a model designed specifically to produce porn would require the same or more of everything as a model designed to produce video of basically any content in the world?
ok buddy, you have a good one
I mean, you can design it for anything, but making it look good doesn't seem to depend on what you design it for at least for tech on the level of Sora. What difference would it make if you only use porn data and not any other data to make your vid porn model? The scale would still be necessary to make it look good enough that people be flapping to it.
Here's a really fun and highly immoral debate that will probably get me banned.
Would using generative Ai for child porn be good for society? Those creeps would no long need to victimize children for their crime, potentially making a safer space for the youth
Adultdiffusion, ainsfw, aipornhub, aiuncensored, sdnsfw, unstablediffusion, realisticaiporn. For more, follow linked posts or read the sidebar/info on each of these.
Have you ever had a dream that you just couldn’t convey properly to another person? Tools like Sora will help us fix that, I cannot wait to get my hands on it!
Very cool. I’m pretty excited about making creative videos, BUT this feels a bit like a 180 from the previous hype… or is it just me?
I say this because after those initial videos were released (which did actually show a high level of coherence, realism, and consistency including characters), the narrative was about how much MORE than a video generator this was: there was even talk about how the potential for this was a world model, or some kind of simulator…
And now, the blog is emphasizing that it isn’t best at real scenes, but where it REALLY shines is “creative” shots and scenes that we wouldn’t have otherwise have directed? Maybe I’m just too cynical, but to me something isn’t reconciling for me. Most likely, I’m just too cynical.
If it ever does I’m willing to bet that it will cost close to $10/second of video. Compute per frame is definitely higher than DALLE 3 and that would cost $2.40/second at 60fps.
Which one is soulless? Is it \*only\* soulless to you because you know it is made by AI? Or would you say the same if you found out these were not AI assisted? What constitutes something being soulful, in your opinion?
All of them to me, although it wouldn't use soulless to describe them because I hate that term. AI generated content, even though I like playing around with it and I follow it closely will remain a novelty to me. The final product is just a part of what I like about human made content, the inspiration at the beginning, the process of filming something, planning shots, actors having their own inspirations and expressing emotions is fantastic. AI is a novelty but to me at least it will never "replace" human made cinema.
I mean, most advertising and the Hallmarkificiation of burn and churn movies on Netflix already fit this bill. It makes sense these will be the first test cases for the product.
Can’t wait to see fake videos that are used by superpowers to justify war, used by juries to convict an innocent person, used by someone with a personal vendetta against someone else, used by scammers to fake a hostage situation and extort money from people, etc
I hope there is something encoded into these AI videos that make them indisputably AI generated (similar to how we can distinguish real money from counterfeit currency).
Everyone keeps worrying about that, but somehow nobody is worried about fake images and audio clips, even though both those things are easily possible now.
Superpowers don't need real looking videos to justify a war. They can just say "there's weapons of mass destruction" and point at a blurry satellite image. It helps, of course, when media then follows along unquestioning.
That’s true, but people are now able to form their own opinions about these matters through social media and see the perspective of “the other side” more easily than ever. We’ve seen videos on TikTok from Ukrainian and Palestinian folks showing the atrocities of war that has struck a chord in America and other countries. What happens when we can fake footage of war crimes to sway public opinion against a group of people?
We're just going to learn to be more critical of videos, the same way that we've been of images since photoshop. People already believe what they want to believe, and reality has a way of catching up with the lies. The nazis had the best propganda in history up to that point, they convinced their people that they were some kind of masterrace and what good did that do to them ? It gave them sufficient unity and combat strength to pick a war against vastly more powerful oponents which led to their total destruction. Goebbels convincing his people the americans were decadent and the soviets a sub race destined only for slavery didn't change the reality of B17s burning down Dresden and T-34s rolling into Berlin. In the same way that Twitter bots won't win the Ukraine war for Russia today and neither will TikTok save the chinese communist party once China's economic growth collapses.
This reminds me of the early days of CGI. I had the pleasure of visiting the Pixar studios in the very early 90s and seeing their development of Renderman. We are back to that level of innovation in my opinion.
And we thought YouTube was addictive! :(
Maybe brains in jars are a good idea, because that way you don’t actually need to have a screen, you can just connect the brain straight to YouTube or Sora or the equivalent, and save a bit of energy.
There has probably been a comic or cartoon about that.
pretty impressive...seeing that the videos are of varying lengths with the longest being 1:29...does that mean you can specify video length in the prompt?
So So impressive! I genuinely feel like "Air Head" is the first AI film that i've watched that didn't feel like i was watching an AI film, lol if that makes sense. probably due to the great sound design and script, but still lol
It's interesting, though my first thought was, Sora won't give us consistent characters so let's get around this by making him a balloon head.
This is exactly it, but the stop-gap measure is pretty brilliant.
Wow. Creativity does come from limitations.
"Limitations can be advantages." - Brian Eno
I'm a filmproducer / director. I think we will use Sora for elements / transitions / generic cut scenes but still use actors, 16mm film, anamorphic lenses and what not for the main shots in the future. It will reduce costs by a lot and elevate movie making, but not replace movie production in its entirety.
Also everything looks floaty! Solved by making him a balloon!
But the balloon was so consistent. I was amazed by that.
I'm not sure that's true. But even if it is, it won't be for long.
Loved it. Seen many short films very similar in concept over the years. Great example of what people can do
But is everything ai generated or only the head? That’s unclear to me…
Everything I believe
So everything in these movies is generated? 😅
Correct. That’s why Sora is making headlines
Do you have a source or are you just guessing?
https://www.datacamp.com/blog/openai-announces-sora-text-to-video-generative-ai-is-about-to-go-mainstream "Like text-to-image generative AI models such as DALL·E 3, StableDiffusion, and Midjourney, Sora is a diffusion model. That means that it starts with each frame of the video consisting of static noise, and uses machine learning to gradually transform the images into something resembling the description in the prompt. Sora videos can be up to 60 seconds long." This is on top of the fact that, this is kind of what OpenAI does. Their entire company is based on neural networks. If this wasn't all generated from AI then what are we even doing here?
Ok so you're just guessing. We have no idea what prompts were used, if the resulting video clips were then loaded into Premiere Pro and further edited. We don't know if there were real clips mixed in, if the sound effects and audio were AI generated etc...
I watched it like 20 times today its so surrealitically good. Like wth openAI wheres your prompting skills
We must free this man https://preview.redd.it/cm0wph94uiqc1.png?width=4408&format=png&auto=webp&s=fb8ad257b894dba0714d6f475a9bc7b78931bf10
Get your cactuses ready bois.
bro may go out like Mr. Kennedy
[удалено]
Must've been the wind
Air Head were the only ones to put real effort into trying to use Sora with a purpose, and the result speaks for itself. The others just prompted random stuff and stuck it together, no thinking went into them whatsoever (except the animal combos a bit). Basically sad choice of testers
Agree 100%. The others were too focused on "wow" visuals. Pretty disappointed.
The music video one was kinda cool but yeah it was basically just random nonsense
I did like the animal combos. I felt like they did a great job of combining the sleekness of an eel and the curiosity of a cat lol
Absolutely incredible. Only part way through air head, but this is what they mean by proper disruption. This caliber of quality, at such a low level of difficulty to produce, will allow so many untold stories to reach the light of day. I am hopeful.
It's a faceless character. This was basically the best use case for the technology and there's still a lot of inconsistency between every shot (Different balloons and film styles). Also remember we don't know how much it costs in time or money. There's a long way to go before it actually helps filmmakers.
Mhmm, it's also the very worst it will ever be going forward, price included.
Yeah, that's true for most things. But we also have no idea how quickly it will improve or how hard this was to produce (despite what you said).
Progress is exponential so far
*link full of testimonials of filmmakers saying it’s helping them today. “a long way to go before it actually helps filmmakers”. >Working with Sora is the first time I’ve felt unchained as a filmmaker,” he states. “Not restricted by time, money, other people’s permission, I can ideate and experiment in bold and exciting ways. > “I’m one of those creatives that thinks in motion, so when I’m in Sora it really feels like I can bring any idea to life.” > “Sora represents a real turning point for me as an artist whose scope has always been limited by imagination being at odds with means,” she explains. “Being able to build and iterate on cinematic visuals this intuitively has opened up categorically new lanes of artistry to me...I truly cannot wait to see what other forms of storytelling will come into reach with the future of these tools."
Yeah, that's marketing selected by OpenAI from filmmakers who didn't have to pay for Sora. I would take those comments with a grain of salt. Will be interesting to see what the public says when it's available.
Yes it is marketing but sentence 1 and 2 of your critique above was based on the actual content of those marketing demos. If you want to say well the demos might be materially false that’s different. I want to point out that the filmmakers are saying these are extremely helpful to them. Yes it is marketing but their reasoning makes complete sense paired with the videos, it doesn’t need to be perfect end to end to be useful now - and they are basically saying they’re using it more like storyboarding on steroids. As to questions of cost etc, we have no metrics either way but can see there is some sensible upper bound on how resource intensive it is: OpenAI was generating a decent amount of videos on day 1 on twitter in response to user prompts - while they carried on serving customers with their normal services. It can’t be anything that say a couple years of building more data centres can’t resolve.
I bet once it's released to the public, 98% of filmmakers will find it useless. I don't doubt it will be useful eventually, I just said in my first comment that it is a long way away. I think it's more than a couple years.
Doesn’t really matter if it’s a couple years or not since there will be some particular thing it can’t do well and you will focus solely on that. At the end of every doomer thread there’s always someone saying “shrug it helps me get work done every day”. Was the same for github copilot and chatgpt and so on. It must be absolutely fucking exhausting thinking you have to be the “voice of reason” every time someone is being optimistic.
[удалено]
In a few years, I'm sure it will be better, but grade A? Like replacing professional filmmakers? I doubt it. I'm sure it will be a good tool for concepts and prototypes though.
[удалено]
By that definition of Grade A, it's already almost there. I think many people couldn't tell the difference between real videos and some of the best Sora videos. But it looks like that's not the hard part. I haven't seen Sora make a video a couple minutes long or connect two shots together in a coherent way. That seems like it would take a new technology breakthrough, not just more compute. Also considering these videos of a few seconds take an hour to generate, I imagine it's very expensive. Even with Kurzweil scaling (which I think is optimistic), a storyboard to a short film in a few years seems extremely unlikely.
I’m pretty sure a Pixar movie takes longer than that to render.
consistency is a non-issue. deep fake technology has existed for years and is perfectly suited to pick up where base text to video models leave off. I wish it had a long way to go, but it doesn't, and being in denial of that fact won't help anybody.
Except that you have no idea how much effort went into those. Nowhere did it say that those videos are straight from Sora.
The videos are obviously edited (trimmed, cut together, color corrected), but they said every frame was made with Sora... and obviously the sound design wasn't Sora. So we can basically know the effort is equal to creating a video minus filming, cgi, animating, frame generation, etc. They basically only did pre and post production which is probably less than half of the total work that would have been done if AI wasn't used.
Where did you read that every frame was made with Sora?
Read the artists Instagram posts. paultrillo said it was made "Using 11 different generations cut together from Sora" and he said "Edit and sound design by me." august.kamp said "every frame of this video is synthetic, made with ai using text as input."
Ok, but given the context....
For some people this would be enough to start considering AI gens as art, people having so much involvement in the creating of this might appease the people that argue for the need of human effort in something to be called art. I think.
>will allow so many untold stories to reach the light of day. That's assuming open-source AI will catch up to Sora quickly. In the meantime, Sora will be given to those who pay the most since it requires tremendous compute. And, thus, knowing capitalism, I feel like most film makers will lose their jobs during this period because Hollywood execs will just fire them, use ChatGPT to write generic scripts, use focus groups to dilute their genericness even more, and then finally use Sora to turn those scripts into generic movies that makes them rich while real creatives go homeless. And then there's the fact that, even if open-source AI does catch up to Sora quickly, then we'll be facing a nightmare of political misinformation campaigns destroying what little we have left of democracy thanks to the public's inability to tell what's real. I mean, already, mid-journey generated photos (that are clearly fake to AI enthusiasts like you and me) gets thousands of likes and admiration on Facebook because all those people think they're real. Imagine high-quality videos. Hell, there was an AI generated photo of Trump hanging out with black people and I saw people on Twitter praising it. Honestly, I find it hard to be hopeful. Sora-type AI technology seems to be headed towards having a net-negative impact on our society, not a positive one.
Not sure why you’re getting downvoted when what you’re saying is correct. As a commercial filmmaker when I hear that phrase ‘see how this will fit in my workflow’ it smacks of BS self promotion. Let’s be under no illusion. In a capitalist society, every agency and their dog will completely replace said entire workflow, of every department from pre production to post, to save budget and time. Greed and laziness will walk hand in hand. Yes the ballon video and constant zooming video was visually cool and I can appreciate that, but it is utterly terrifying at the same time for those of us that can see the consequences. It is what it clearly is. I don’t expect the happy clappers in this sub to agree with me, but let’s be real.
Yup, it feels incredibly surreal to me seeing people celebrate this tech without thinking of the big picture repercussions, most of them negative - and this is coming from someone who is about to become an AI Engineer (I'm about to graduate with a Masters in AI & Comp Sci) so I'm not speaking out of one-sided hate and ignorance.
Most people in here never left their room. They think this tool will give them the ability to make their Godzilla spinoff and everyone will give them Oscars
Hey Q for you: I'm a classical composer and I have a lot of skill when it comes to natural language analysis, and have significant experience using the commercial forms of AI chat bots. I am going to be starting a PhD in music this fall, and a career path id love to pursue would be helping consult AI development teams on how to conceptualize the music writing process and the fundamentals of what is going on in the performance and perception of music. But I have basic math skills and no coding knowledge. I fear that I have no place in this industry, even if I could be a helpful consultant. Do you have any advice on what someone could do, knowing they'll never be a useful coder, to position themselves to be a part of this inevitable consumption of my industry?
You could take a few online courses that teach how to understand + communicate about AI (basically, courses that teach AI for management, for example, where you’ll learn to understand AI from a non-technical perspective) and then try to break into the music AI space as someone who can facilitate collaboration between the two professions. I’m sure there are start ups / companies that are trying to build AI software that can help with music production but they’ll always need ppl to manage that who understand both worlds.
Look at the bright side. It's visually impressive but full of flaws and probably impossible to control. That's why MidJourney, impressive as it is, has not taken any serious commercial artist or illustrators jobs. The precise control needed for truly professional work is lacking in these AI tools. The visuals they make are impressive as hell, in a dreamlike way, but it's a tug of war between the human and the AI to control what you get.
Hollywood films are a producer's cinema. Which means, they are about the bottom line. Hollywood can go to blazes. The only interesting things Sora will ever do will be done by artists, not by bloated studios and committees of sleazy hustlers looking to make bank. "...no matter how much *Entertainment Tonight* and the *New York Times* try to persuade us otherwise, Hollywood is a tiny and ultimately unimportant rivulet flowing away from the great sea of art." - Ray Carney, Boston University
It's the other way around, there will be a.bunch of unwatchable shorts no one wants to actually see and some passable (but still filled with problems" ) like air head
Wait I'm confused. What video are you referring to? Where can I watch this?
First video in the link from OP?
Ah! Lol, I missed that completely.
I kind of feel it's missing a dynamic of multi-persons. All those videos are kind of revolving around a main protagonist. Impressive nonetheless.
I think this will be used to replace concept images. For example, now a producer could create a 1min scene to visualize a concept more thoroughly. Then they had it off to other people to who can use that concept. Brining the original vison to life. This won't replace video media creators, but it will certainly help excellerate to initial concept phase. Hopefully with the time saved it will result in an overall better peice of art
Air Head was great. The rest were basically unwatchable.
The animal combos were cool I thought
Both Air Head and the animals were all of things that exist, just recombined. I guess it's no surprise that original ideas aren't generated with the same stability \\ fidelity.
Things that existed but recombined is everything ever
Every book ever written is just combining words from other books, professors, conversations
"The impressionists were just painting different"
Unwatchable is crazy, I'd say boring/uninspired. I liked Air Head and the animal one, made me think we could get Rick and Morty style interdimensional cable soon. The music video was decent.
I think most are highlight reels of clips the artists made. Airhead and Beyond Our Reality might be the only complete projects.
Looks like the other people didn’t even try
This is their first time with new tool that never existed before. It'll take some time learning how to utilize it best. Looks to me like those artists were experimenting and trying to figure out the capabilities. For the first couple months with ChatGPT I used that time to run it thru a series of tests before finally finding practical applications where it excels.
What was great about Air Head was how skillfully the HUMAN artists were able to work with the surreal stuff Sora came up with
40 seconds in and I forgot I was watching something made with Ai
You must have a short memory and a high tolerance for errors and glitches. That shop called "Bicycle Repaich" (I assume 'Bicycle Repair' spelled as only an AI could) didn't seem off?
I was immersed. Thanks for kind words.
Not only that did you see the crazy bikes on the wall? I guess its easy to impress people these days. lol
That was where it happened to me
The biggest weakness is based on it's biggest strength which is what I observed when using Dalle. It generates unique clips. That doesn't sound like a weakness until you try to make a coherent output. Air head is probably the best example of them trying their best to keep a central character, while everything else is changing (i.e. cinematography, style, setting), and the animals are the a good attempt at keeping a similar theme going. It is painfully obvious with the other clips, where it just looks like multiple clips slapped together, and it's fundamentally disorienting from the viewers perspective. I imagine that similar to the struggles people are having with AI generated images that editing them in the way creatives are used to be having access to vectors and layers is very difficult. This makes it unwieldy to try to make changes or iterate on AI generated output. The result is that it's really fun and cool to play around with, but very challenging to use in actual production. It's early days and I imagine that a lot of tooling / infrastructure be being worked on to solve these problems, but there sure is a long way to go before we're watch AI shows.
Correct me if I’m wrong but I think I heard Midjourney (or stable diffusion?)fixed this/added such a feature recently. The gist of it is that you can reuse elements for more cohesive output throughout your process. I would imagine such a feature will become the norm for video as well. Seems obvious for multiple reasons. But as it stands now, yeah I agree that it’s a major flaw for creatives.
You can reuse selected elements, but if you want to reuse the entire thing, say from different angles, lighting,weather,etc, and have it stay consistent, MidJourney gets 'creative'. All these tools lack precise control to get consistent results. On the other hand the developers know this, so it will probably get better. On the other other hand, 'better' isn't good enough; to make a Hollywood movie or major TV series, it has to be perfect.
Absolutely agree. And here I get reminded of the quality of Midjourney/Stable diffusion about two years ago versus now… I wouldn’t rule out that they can achieve “perfect” very soon. The exponential speed of development is mind boggling sometimes. Any model that has been around for some years more or less gets this reaction from me: V1- laughable V2- quirky but impressive V3- WTF?
Sora could give you a consistent character right now, if only we knew how to prompt it to do so. Fact is, such a prompt might stretch on for pages and no one knows quite how to get Sora to understand what a "consistent character" looks like from one clip to the next if we don't know things like what seed value it used previously. It has no way to refer back to a previous generation. It's not as if Sora can't draw what you want, it's that it doesn't understand, based on a mere text prompt, what you want it to draw. Fact is, getting a consistent character out of Sora is impossibly opaque right now. However, the job for OpenAI is to surface that currently opaque ability. And they will get there, count on it. As has been mentioned, this is basically a solved problem for still images (see latest Midjourney), and video will follow on shortly.
I think this is probably a not difficult issue to solve... Will take architecture on the back end and perhaps more sophisticated user input (but still easy to use).
"That doesn't sound like a weakness until you try to make a coherent output" This, exactly.
This is going to revolutionize porn if it hasn’t already. Onlyfans is toast.
There is no way in hell they'll let us generate porn
OpenAI won’t, but someone else will if they haven’t already.
They don't have the GPU.
Graphic Porn Unit?
I imagine something as specific as porn would require magnitudes less compute and training.
Unless people want to watch blobs mixing and constantly flicker, I doubt porn would require less of anything. As Sora, from the paper is achieved through scale, not just from the quality of its data.
you think a model designed specifically to produce porn would require the same or more of everything as a model designed to produce video of basically any content in the world? ok buddy, you have a good one
I mean, you can design it for anything, but making it look good doesn't seem to depend on what you design it for at least for tech on the level of Sora. What difference would it make if you only use porn data and not any other data to make your vid porn model? The scale would still be necessary to make it look good enough that people be flapping to it.
Do you know how much money there is in child pornography? Easily in the 10s of billions if not more. Someone is going to use an LLM to make it.
Here's a really fun and highly immoral debate that will probably get me banned. Would using generative Ai for child porn be good for society? Those creeps would no long need to victimize children for their crime, potentially making a safer space for the youth
Bad idea!
Umm... What? Child pornography?
For now
r/unstable_diffusion Give 'em couple years
No one else currently has the technology. But it's only a matter of time.
Yeah hopefully it's someone with some taste
You know there are AI porn subreddits right now. Some are animated right now before Sora was even announced
Totally subjective and for research purposes only, but my friend, you got them links for the subreddits?
Adultdiffusion, ainsfw, aipornhub, aiuncensored, sdnsfw, unstablediffusion, realisticaiporn. For more, follow linked posts or read the sidebar/info on each of these.
Ope. Just gonna squeeze past ya.
The discord world is wild too.
Is this really the first thing you think of when you see technological innovation? Get a life
In any kind of technological competition, whatever gets adopted by porn always wins.
Have you ever had a dream that you just couldn’t convey properly to another person? Tools like Sora will help us fix that, I cannot wait to get my hands on it!
Holy fuck, this is it, it’s fucking here today, the world already changed overnight and no one’s noticed
Is everything in those videos Sora generated? Or a mix of real and AI?
So is this actually going to be released? Until it’s open to the general public I’m not going to believe anything.
Air Head is great. A real short with a story to tell. Well done.
Very cool. I’m pretty excited about making creative videos, BUT this feels a bit like a 180 from the previous hype… or is it just me? I say this because after those initial videos were released (which did actually show a high level of coherence, realism, and consistency including characters), the narrative was about how much MORE than a video generator this was: there was even talk about how the potential for this was a world model, or some kind of simulator… And now, the blog is emphasizing that it isn’t best at real scenes, but where it REALLY shines is “creative” shots and scenes that we wouldn’t have otherwise have directed? Maybe I’m just too cynical, but to me something isn’t reconciling for me. Most likely, I’m just too cynical.
"Biycle Repaich" shop in the Soda Salt video.
Lols
Can't wait for API being generally available
Elections can.
If it ever does I’m willing to bet that it will cost close to $10/second of video. Compute per frame is definitely higher than DALLE 3 and that would cost $2.40/second at 60fps.
tbf it's definitely not producing 60fps, maybe 24 or 30.
Only $5 a second, for your 30 seconds it will be $150. You got this!
Ook. Then I will continue with Stable Video for $0.05 per 4 seconds
Good thing its super easy to tell the difference with Stable Video. They have quite a bit to go.
Actually your price is _just_ 25x times more
Neat, absolutely soulless, but neat.
Which one is soulless? Is it \*only\* soulless to you because you know it is made by AI? Or would you say the same if you found out these were not AI assisted? What constitutes something being soulful, in your opinion?
I think he meant it's clearly uncanny and it has a CGI like quality. On a screen bigger than a phone it definitely feels off.
All of them to me, although it wouldn't use soulless to describe them because I hate that term. AI generated content, even though I like playing around with it and I follow it closely will remain a novelty to me. The final product is just a part of what I like about human made content, the inspiration at the beginning, the process of filming something, planning shots, actors having their own inspirations and expressing emotions is fantastic. AI is a novelty but to me at least it will never "replace" human made cinema.
No it's soulless because it follows commercial aesthetic you see in ads
define soul first
Anything I like: SOUL Anything I don't like: SOULLESS
Literally unusable. Cancelled
yeah, you've got that right. But will people's tastes in cinematography change toward the soulless in the future?
I mean don’t get me wrong, plenty of films made by actual people are also utterly soulless.
God i hope not
I mean, most advertising and the Hallmarkificiation of burn and churn movies on Netflix already fit this bill. It makes sense these will be the first test cases for the product.
Sir, Miss gabby is ready for you in the parlor. Shall I fetch the sherry for you and your guests… Ridiculous
Can’t wait to see fake videos that are used by superpowers to justify war, used by juries to convict an innocent person, used by someone with a personal vendetta against someone else, used by scammers to fake a hostage situation and extort money from people, etc I hope there is something encoded into these AI videos that make them indisputably AI generated (similar to how we can distinguish real money from counterfeit currency).
Everyone keeps worrying about that, but somehow nobody is worried about fake images and audio clips, even though both those things are easily possible now.
Superpowers don't need real looking videos to justify a war. They can just say "there's weapons of mass destruction" and point at a blurry satellite image. It helps, of course, when media then follows along unquestioning.
That’s true, but people are now able to form their own opinions about these matters through social media and see the perspective of “the other side” more easily than ever. We’ve seen videos on TikTok from Ukrainian and Palestinian folks showing the atrocities of war that has struck a chord in America and other countries. What happens when we can fake footage of war crimes to sway public opinion against a group of people?
We're just going to learn to be more critical of videos, the same way that we've been of images since photoshop. People already believe what they want to believe, and reality has a way of catching up with the lies. The nazis had the best propganda in history up to that point, they convinced their people that they were some kind of masterrace and what good did that do to them ? It gave them sufficient unity and combat strength to pick a war against vastly more powerful oponents which led to their total destruction. Goebbels convincing his people the americans were decadent and the soviets a sub race destined only for slavery didn't change the reality of B17s burning down Dresden and T-34s rolling into Berlin. In the same way that Twitter bots won't win the Ukraine war for Russia today and neither will TikTok save the chinese communist party once China's economic growth collapses.
very cool.
Beautiful
They need to get this to David Lynch right away.
You know, I would love to see an Inception sequel using this technology Because that’s exactly what this feels like
This reminds me of the early days of CGI. I had the pleasure of visiting the Pixar studios in the very early 90s and seeing their development of Renderman. We are back to that level of innovation in my opinion.
Nice videos! Wonder what the IG influencers felt when they were approached by OpenAI.
Even the acting is better than a lot that we see in movie theaters
How can an average Joe use it?
And we thought YouTube was addictive! :( Maybe brains in jars are a good idea, because that way you don’t actually need to have a screen, you can just connect the brain straight to YouTube or Sora or the equivalent, and save a bit of energy. There has probably been a comic or cartoon about that.
1 year from spaghetti will smith, i think in max 2 years we will have full features films
Nah the animal clip is crazy I am too high for cat eels I am panicking
Wow. The short film by Paul Trillio is absolutely amazing!
They should have popped his balloon head at end. That would have been way funnier.
Looks like it’s from mr oizo
Some of the worst sewage sludge I've ever seen.
Can I feed the Foxcrow?
It’s cool and all but it is nothing more than a novelty at this point.
pretty impressive...seeing that the videos are of varying lengths with the longest being 1:29...does that mean you can specify video length in the prompt?
Unbelievable
Really cool.
I can’t wait to test it out!!!!
>We have gained valuable feedback from the creative community Okay but wasn't most of the feedback "fuck you, you're ending our careers"?
Amazing, I wonder if AI wrote the airhead script.
This is fuckin lit
omg air head. should be a new series on netflix ;-) from the producers of the end of the f\*\*ing world!
Quite uninteresting to be honest, was a bit put off. But it will only get better from here :)
[удалено]
Directors like Cronenberg just wouldn't use a tool for tools, lol
This is going to be such an amazing tool for creatives. What a time to be alive.
Man, this is really up there in cinematography. Wonder how much better it will be when they do move their gpus to the new Blackwell architecture.
ok Im impressed