Exploring the use of physical interfaces, depth, diffusion, and mixed reality.⁣
⁣
#MixedReality #MR #AI #StableDiffusion

Quick one... Using depth to give volume and clip the background.⁣
⁣
— Mixed Reality + Diffusion prototype⁣
⁣
#MixedReality #MR #AI #StableDiffusion

Mixing flat and ‘3D’ snapshots to create a more immersive scene. The recording doesn’t quite capture the sense of depth on the heads—but in the Quest, it feels great.⁣
⁣
—Mixed Reality + Diffusion to explore concepts, styles, and moods.⁣
⁣
#MixedReality #MR #AI #StableDiffusion #Quest3

Live-tweaking the depth displacement—Mixed Reality + Diffusion prototype to explore concepts, styles, and moods.⁣
⁣
#MixedReality #MR #AI #StableDiffusion #Quest3

Early test run with freshly added depth estimation — Mixed Reality + Diffusion prototype to explore concepts, styles, and moods.⁣
⁣
#MixedReality #MR #AI #StableDiffusion #Quest3

I’ve been using that same alleyway as a sandbox for years—now with the Mixed Reality + Diffusion prototype to explore concepts, styles, and moods.⁣
⁣
#MixedReality #MR #AI #StableDiffusion #Quest3

Mixed Reality + Diffusion prototype as a tool for exploring concepts, styles, and moods by transforming real-world surroundings into alternate realities.⁣
⁣
#MixedReality #MR #AI #StableDiffusion #Quest3

Exploring how the prototype can be used to research concepts and styles—by transforming snapshots and anchoring them back into the real world.⁣
⁣
#MixedReality #MR #AI #Passthrough #StableDiffusion #Quest3

Researching a darker mood with this one.⁣
⁣
Mixed Reality + Diffusion prototype.⁣⁣⁣⁣⁣
⁣
#MixedReality #MR #AI #StableDiffusion #Quest3

Away for the long weekend visiting family…⁣
Once again using the Mixed Reality + Diffusion prototype to transform the environment.⁣
⁣
#MR #AI #Passthrough #StableDiffusion #Quest3

Wishing the grey weather would go away.⁣
⁣
Mixed Reality + Diffusion prototype using Quest Passthrough Camera API and SDXL Turbo.⁣⁣⁣
⁣
#MR #AI #Passthrough #StableDiffusion #Quest3

This time, my son had a Bob the Builder flashback with the Mixed Reality + Diffusion prototype.⁣
⁣
Using the Quest Passthrough Camera API and SDXL Turbo.⁣⁣
⁣
#MR #AI #Passthrough #StableDiffusion #Quest3

Today my son took over the Mixed Reality + Diffusion prototype… First stop: Mario Kart.⁣
⁣
#MR #AI #Passthrough #StableDiffusion #Quest3

In this iteration, I’ve added SAM 2 to our workflow to segment people. Lisa and I had fun testing it in our lab—striking poses in sequence, with our bodies precisely isolated for a refined Stable Diffusion effect.⁣⁣
⁣⁣
#MR #AI #Passthrough #StableDiffusion #Quest3

Just updated my MR + Diffusion prototype to use Meta’s Passthrough Camera API. It’s a raw port for now; next, I'll focus on UX exploration. It’s now much easier to do a screen recording.⁣

#MR #AI #StableDiffusion

Daylight saving — Spring is coming — Mixed Reality + Stable Diffusion.

#MR #AI #StableDiffusion #spring

I tried the XGrids Lixel L2 Pro thanks to skytech-drones-inc and XGrids. This LiDAR-based scanner is quite impressive. Here is a capture, rendered as 3D Gaussian splats, of the staircase of our building I captured while going up the levels.

#gaussiansplats #3dscan #gaussiansplatting #digitaltwin

Mixed Reality + Stable Diffusion — Trying to escape the winter.⁣
⁣
#MR #AI #StableDiffusion #Quest3 #madewithunity #montreal

Mixed Reality + Stable Diffusion — AI Urbex
#MR #AI #StableDiffusion #urbex #Quest3 #madewithunity

Mixed Reality + Stable Diffusion — How my desk might look after years of being abandoned. ⁣
⁣
#MR #AI #StableDiffusion #Quest3 #madewithunity

MR + Stable Diffusion Patchwork ⁣
⁣
#MR #AI #StableDiffusion #ComfyUI #Quest3 #Meta #MadeWithUnity

Quickly capturing a series of spatial snapshots, close to one another, of my surroundings, resulting in an alternate reality patchwork once processed through a Stable Diffusion workflow.⁣ The snapshots, not being perfectly aligned, create a sense of depth.⁣

#MR #AI #StableDiffusion #ComfyUI #Quest3

Got a bit trigger-happy capturing Mixed Reality snapshots — Captured images from the Quest 3 passthrough feed are processed in real-time with a Stable Diffusion workflow and displayed back on the Quest.⁣
⁣
#MR #AI #StableDiffusion #ComfyUI #Quest3 #meta #madewithunity

[02/02] Took my MR Diffusion experiment outdoors in -23°C! Quick tests since I deployed the img2img Diffusion workflow on runpod_io. Even though it’s running on an RTX4090, perf. isn’t as on my local rig—in part b/c I'm in MTL while the server is in OR.

#MR #AI #StableDiffusion

[01/02] Took my MR Diffusion experiment outdoors in -23°C! Quick tests since I deployed the img2img Diffusion workflow on RunPod io. Even though it’s running on an RTX4090, perf. isn’t as on my local rig—in part b/c I'm in MTL while the server is in OR.

#MR #AI #StableDiffusion

Anxiyeti (by ponymtl) and a raccoon...

Mixed Reality Diffusion — Captured snapshots from the Quest 3 passthrough feed are processed in real-time with a Stable Diffusion workflow and displayed back on the Quest.⁣
⁣
#MR #AI #StableDiffusion #ComfyUI #Quest3 #meta #madewithunity

Robots, Dinosaurs and Ghosts... ⁣

Mixed Reality Diffusion — Captured snapshots from the Quest 3 passthrough feed are processed in real-time with a Stable Diffusion workflow and displayed back on the Quest.⁣
⁣
#MR #AI #StableDiffusion #ComfyUI #Quest3

Time to experiment with this type of interface to feed and interact with a real-time img2img diffusion workflow.⁣
⁣
Mixed Reality Diffusion — Captured snapshots from the Quest 3 passthrough feed are processed in real-time with a Stable Diffusion workflow and displayed back on the Quest.⁣

First pass of optimization completed!⁣
Mixed Reality Diffusion — Captured snapshots from the Quest 3 passthrough feed are processed in real-time with a Stable Diffusion workflow and displayed back on the Quest.⁣⁣
⁣
#MR #AI #StableDiffusion #ComfyUI #Quest3

First prototype using the Quest 3 passthrough feed — Captured snapshots are processed in real-time with a Stable Diffusion ComfyUI workflow on a local machine and sent back to the Quest.⁣
⁣
Video at 2x speed. Next: optimization, etc !⁣
⁣
#MR #AI #StableDiffusion #ComfyUI #Quest3