🕹️ Finished my little game, Spatial Snake. It’s available on the App Store. Feel free to try it! And don’t forget to share your score with Haiku, written by on-device AI (FoundationModels)!

#swiftui #realitykit #visionos #visionpro #spatialcomputing #mixedreality #foundationmodels #xr

Tried a sphere as a base shape for the Spatial Snake. Looks interesting, but it feels like it decreases spatial awareness a bit.

Plus, when you use cubes, you have a directional affordance for in which direction you can poke the shape. Spheres lack this.

#swiftui #realitykit #visionos #visionpro

Preflight window showing an AI assistant on the left side, a dual viewport of Hydra Storm and RealityKit in the center, and inspector on the right side and a list of validation items on the bottom. The model showcased is a toy plane.

We’re happy to share that Preflight, the quality gate for OpenUSD, is now in public beta! 🛫

Learn more and sign up here: preflight.reality2713.com

@elkraneo.bsky.social @reality2713.bsky.social
#OpenUSD #USDZ #HydraStorm #RealityKit

Made a share score screen for the ARSnake game I posted last time. The cubes’ composition is a 2D projection of your snake's final state.

There is a haiku to celebrate the challenge you have taken. The haiku is generated by Apple’s FoundationModels (on-device!).

#swiftui #realitykit #visionos

Added a menu and sounds to my lil AR game. It’s really great that audio spatialization is coming by default in VisionOS. It helps significantly improve spatial awareness of the experience.

#swiftui #realitykit #visionos #visionpro #spatialcomputing

Made a lil attraction physics experiment using RealityKit. Runs on Apple Vision Pro.
#spatialcomputing #realitykit #visionos

Played with the 3 Newton's motion laws in RealityKit. ECS is fun!
#spatialcomputing #xr #realitykit #visionos #ecs

Tried to use Minecraft-sized voxels in my previous RealityKit experiment. It won’t be practical for indoor use, but I can see some use cases for this size if you're designing in the field.

#spatialcomputing #visionos #realitykit #spatialdesign

Prototyped a little VisionOS game based on the previous RealityKit experiment.

I plan to juice it (or lose it) and release it on the App Store. Stay tuned!

#swiftui #realitykit #visionpro #spatialcomputing

Added an emission shader to my last prototype. Looks nice too. And useful, if you're hacking around late at night!

Love how gracefully VisionOS handles body and object occlusion.

#spatialcomputing #visionos #swiftui #realitykit #spatialdesign

Made another prototype to explore how you can create a voxel with hand-tracking. When you push the main voxel, it generates “wireframe” voxels along its path.

Tools: XCode + RealityKit + SwiftUI
Device: Apple Vision Pro

#spatialcomputing #visionos #realitykit #swiftui #prototyping

I Spent Way Too Long Getting Blender Animations into Vision Pro So here’s the thing about Apple Vision Pro development that nobody warns you about: getting animated 3D characters into your app is way harder than it should be.

📢 AVP Animation Exporter Pro is a new Blender addon for exporting skeletal animations to USDZ format, optimized for Apple Vision Pro and Reality Composer Pro. @mikebundy.bsky.social shares his thinking on the project in this article.
#visionOS #RealityKit #Blender
stepinto.vision/articles/i-s...

Spatial is a collection of types for working with 3D mathematical primitives. These types are loaded with methods to solve common 3D math problems.
#SwiftUI #RealityKit #visionOS
stepinto.vision/example-code...

Starting in visionOS 26, we can observe changes on RealityKit entities. Let's observe an entity position and a value in a custom component. We can use the values directly in SwiftUI views or listen for changes and apply side effects.

#visionOS #SwiftUI #RealityKit

stepinto.vision/example-code...

We can drop GeometryReader3D and use onGeometryChange3D scale RealityView content based on the the size of a volume.

#SwiftUI #RealityKit #visionOS

stepinto.vision/example-code...

depiction of audio in 3D

depiction of audio in 3D - from an angle to show the waveforms

Audio spectrum in 3D #visionOS #RealityKit #FFT #AudioVisualization

Read meta data from Image Presentation Component This component provides access to aspect ratio, image size, and the size of the presentation in our scene.

When working with Image Presentation Component, we can read aspect ratio, image size, and the size of the presentation in our scene.

#visionOS #RealityKit #SwiftUI

stepinto.vision/example-code...

Please watch our announcement video to meet the team who will build the future of Step Into Vision.

Joseph is thrilled to welcome our full team: Jimmy Balladares, Roxana Monica Nagy, Cristian Díaz, Paolo Villanueva and Michael Bundy

#AppleVisionPro #visionOS #SwiftUI #RealityKit #SpatialComputing

We can pre or post-generate Spatial Scenes with Image Presentation Component. Take a look at the difference between these two approaches.

#visionOS #RealityKit #SwiftUI

stepinto.vision/example-code...

Crude audio visualization working in #RealityKit in #visionOS, #FFT #AudioVisualization; there are some concurrency issues that need fixing; first prettify the waveforms.

A guest Lab from @michaeltemper.bsky.social that visualizes a Vector for an entity in 3D space.

#RealityKit #visionOS

stepinto.vision/labs/lab-096...

To follow up from the spatialOverlay example, we can also define custom alignment points using AlignmentID. This examples shows points on the front a volume, you can do this with depth inside the volume too!

#visionOS #SwiftUI #RealityKit

stepinto.vision/example-code...

A screenshot from the Example Code section in Step Into Vision

This week we're working on example code for Image Presentation Component in RealityKit

#RealityKit #SwiftUI #visionOS

stepinto.vision/category/exa...

We can use Image Presentation Events to update our UI or environment when transitioning between viewing modes.
Caveat: not all transitions fire the TransitionStarted event.

#visionOS #SwiftUI #RealityKit

stepinto.vision/example-code...

Lab 095 – World, Local & Object Space Shows the movement in World, Local and Object Space.

Another guest lab from Michael Temper, showing how entities move in World, Local and Object Space.

#visionOS #SwiftUI #RealityKit

stepinto.vision/labs/lab-095...

Deep Dive into Animation on visionOS Explore how the animation tools and rendering paths on visionOS can enhance your spatial applications. Learn how temporal cues improve user clarity and comfort while navigating spatial changes.

Today we are publishing the 400th post on Step Into Vision 🎉

Read the Deep Dive into Animation on visionOS by Cristian Díaz

#visionOS #SwiftUI #RealityKit #SpatialComputing

stepinto.vision/articles/dee...

Decorative image on the outline in Safari in the visionOS simulator

We have more than 20 example code articles covering SwiftUi Gestures, Gesture Component, and Manipulation Component. Check out the whole series here.
#visionOS #SwiftUI #RealityKit
stepinto.vision/learn-vision...

Exploring Ways to Load 3D Models in RealityKit for visionOS Learn how to load 3D models in visionOS using RealityKit. Explore Reality Composer Pro, ModelEntity, Model3D, and remote asset loading

🥽 𝐸𝑥𝑝𝑙𝑜𝑟𝑖𝑛𝑔 𝑡ℎ𝑒 𝐷𝑖𝑓𝑓𝑒𝑟𝑒𝑛𝑡 𝑊𝑎𝑦𝑠 𝑡𝑜 𝐿𝑜𝑎𝑑 3𝐷 𝑀𝑜𝑑𝑒𝑙𝑠 𝑖𝑛 𝑣𝑖𝑠𝑖𝑜𝑛𝑂𝑆 by Anas Belkhadir

Ready to bring spatial experiences to life? Different ways to load and integrate 3D models using RealityKit.

#Swift #visionOS #RealityKit #iOSDev

swiftorbit.io/load-3d-mode...

Environment Blending Component gives us some control over how how entities blend in with objects in our environment.

It's not perfect or instantaneous, but it is pretty neat. Hopefully we'll see this component improve over time.

#visionOS #RealityKit

stepinto.vision/example-code...

RealityKit simplifies many common actions like spin, orbit, playing audio, etc. These Entity Actions can be used in code or in Timelines when using Reality Composer Pro.

#visionOS #RealityKit

stepinto.vision/example-code...