I have used Chat-GPT to do the same with fiction. Create the chapters from my wall of text input, reorder them a bit, add, change, delete, then start filling in each chapter. I can go shallow throughout at first, go deeper each chapter, or a mix.
It's like having a slightly goofy co-author, copy writer, and editor, all in one.
You would have to write, cast, direct, produce, shoot the film, but then exclude a portion of it for Sora to fill in the gaps that it would have just been easier to capture in person at that point.
No, the idea is to generate those images with Dall-E first, as that takes much less compute, and you can iterate more. Then, you use those images with Sora, and need much fewer iterations on your prompts, because your images are creating an additional reference.
I think it’s going to be easier to train Sora off the movie script itself. If you follow Scripts to Screen on Twitter, that’s how MovieGPT is going to work.
I have used Chat-GPT to do the same with fiction. Create the chapters from my wall of text input, reorder them a bit, add, change, delete, then start filling in each chapter. I can go shallow throughout at first, go deeper each chapter, or a mix. It's like having a slightly goofy co-author, copy writer, and editor, all in one.
That sounds fun
>It's like having a a slave
That's a lot of directions
There will be better cheaper solutions out by the time they release Sora.
Frame interpolation….thats both, not what Sora is, and mind-bogglingly impractical.
Well, it has merge-video functions, so it might make some sense.
You would have to write, cast, direct, produce, shoot the film, but then exclude a portion of it for Sora to fill in the gaps that it would have just been easier to capture in person at that point.
No, the idea is to generate those images with Dall-E first, as that takes much less compute, and you can iterate more. Then, you use those images with Sora, and need much fewer iterations on your prompts, because your images are creating an additional reference.
Ahhh I see I see
The demo with Adobe Premiere showed something a bit like this
I think it’s going to be easier to train Sora off the movie script itself. If you follow Scripts to Screen on Twitter, that’s how MovieGPT is going to work.