AI V2V

Really nice demo of what @runwayml Aleph can do for complex changes in environments while adding accurate dynamic elements like snow on the shoulders or splashing water as the characters move.

Introducing Modify with Instructions | Luma AI

Awan Sto (@akunesia.prodig) on Threads

SaaS Junction || AI & SaaS Updates (@saasjunctionhq) on Threads

Yes, @runwayml  Aleph is awesome! I tend to always test very stylized imagery since AI can handle photorealism quite easily BUT I wanted to reverse my experimentation and start with something stylized and see if Aleph can actually make it look photorealistic. It actually did it

VIGGLE + COMFYUI - CRAZY COMBO

With @runwayml's new Aleph model you can change an existing video's environment, angle, background, lighting, etc. with simple text prompts.

For this example I used this prompt for the video below:

"Change the camera angle to be an aerial drone shot looking down as this woman

❤️ Runway Aleph 

Currently battling the overwhelming urge to ignore every deadline and just experiment endlessly with Aleph 😍

'leaving the first frame unchanged rapidly dissolve the person into [material] particles that completely clear before the last frame'

Last video is

Runway Aleph → Woah.

It’s a new way to think about things.

TESTS:
+ Changing Perspectives
+ Changing Backgrounds
+ Changing Shot Types
+ Changing Small Details

So much more to run through with this thing.

#runwayml #promptshare

People keep asking if @LumaLabsAI can do Ai crowds so Jack and I thought I’d see how “Modify with instructions” does with me playing rockstar.

That's it — another megathread.

Best of Runway Aleph (Day 2):

1.

시바 AI (@itsshibaai) on Threads

Add/edit instead of removing. Same model, just a different ask. Aleph also works really well with editing reality. Everything can become a prop. 

The first video was the input in this example.

피카쏭_A2O 크리에이터 (@picassong.art) on Threads

Jack Fishkin playing with removing things using @LumaLabsAI modify with instructions. (Coming very soon)