Awesome-RealityKit

Awesome RealityKit

Awesome projects and resources about RealityKit. Feel free to contribute!

The RealityKit framework was built from the ground up specifically for augmented reality with photo-realistic rendering, camera effects, animations, physics, and more. With native Swift APIs, ARKit integration, incredibly realistic physics-based rendering, transform and skeletal animations, spatial audio, and rigid body physics, RealityKit makes AR development faster and easier than ever before.

• Projects
  • Community
    • Samples
    • Packages
    • VisionOS
  • Apple
• Resources
  • Articles
  • Apple
  • WWDC
    • 2023
    • 2022
    • 2021
    • 2020
    • 2019

Projects

Community

Samples

• RealityKit-Sampler - RealityKitSampler is a sample collection of basic functions of RealityKit, Apple’s AR framework for iOS
• RealityKit CardFlip - RealityKit CardFlip game
• RealityKit 2 DrawableQueue - A sample project demonstrating a usecase for the DrawableQueue API in RealityKit 2
• RealityKitLaunchScreen - A launch screen made with SwiftUI and RealityKit
• Glass-Fit - Glass-Fit is an open-source iOS app demo that showcases the power of RealityKit in making 3D overlays effortless using Reality Composer
• Capturinator - Powered by RealityKit, Capturinator is a Mac app that turns photos of an object taken at multiple angles into 3D USDZ models.
• RealityKit_ARQL - Using RealityKit to implement ARQuickLook functions

Packages

• RealityActions - RealityActions brings the popular Cocos2D-style action framework to Entities in RealityKit.
• FocusEntity - FocusEntity lets you see exactly where the centre of the view will sit in the AR space
• RealityUI - RealityUI is a collection of User Interface classes for RealityKit
• Mirador - Mirador makes it easy to build impressive point-of-interest AR experiences on top of Apple’s new AR platform, RealityKit
• RealityKit-Collisions - This is a convenience API for setting Collision Filters in RealityKit
• RealityGeometries - Add more geometries to your RealityKit projects
• BodyTracking - This package includes classes that enable easy, convenient body tracking in RealityKit
• Euclid - Euclid is a Swift library for creating and manipulating 3D geometry using techniques such as extruding or “lathing” 2D paths to create solid 3D shapes, and CSG (Constructive Solid Geometry) to combine or subtract those shapes from one another.
• reality-dump - swift-custom-dump extension for RealityKit
• Reality Morpher - Adds Morph Target / Shape Key / Blend Shape animations to RealityKit
• GoncharKit - RealityKit helper functions for visionOS
• ShaderGraphCoder - An embedded DSL to write RealityKit shaders in Swift.
• HandVector - HandVector uses Cosine Similarity Algorithm to calculate the similarity of hand gestures in visionOS, and with a macOS tool to test hand tracking in visionOS simulator.

VisionOS

• ImmersiveMoveAndRotate - Example project showing how an immersive scene on visionOS can contain a RealityView that presents a ModelEntity and how that entity can be dragged using DragGesture and rotated using RotateGesture.
• VisionCraft - Minecraft Clone in Apple Vision Pro
• GenerativeDoodleArt_VisionOS - Explore the transformative capabilities of visionOS by creating augmented reality wall art using Vision Pro
• VOClimateSpiral - Very simple AR app in visionOS, that shows the climate spiral, which is known as a way to visualize global surface temperature change
• MacCast - Cast Mac windows to visionOS
• HandsWidth - Measure app by hand tracking for Apple Vision Pro
• BeatmapVisionPro - Beat Saber map (a.k.a beatmap) visualizer for the Apple Vision Pro. This project is the successor of BeatmapAR for iOS.
• ALVR-VisionOS - Experimental visionOS client for ALVR - SteamVR on Apple Vision Pro

Apple

• Building an Immersive Experience with RealityKit - Use systems and postprocessing effects to create a realistic underwater scene
• Controlling Entity Collisions in RealityKit - Create collision filters to control which objects collide
• Creating a game with scene understanding - Create AR games and experiences that interact with real-world objects on LiDAR-equipped iOS devices.
• Creating a Game with Reality Composer - Design your app’s visual look and behaviors in Reality Composer, and complete the gameplay experience by using custom RealityKit code
• SwiftStrike: Creating a Game with RealityKit - Create a multiplayer game with ARKit, RealityKit, and Swift using the SwiftStrike app as a guide
• Hello World - Use windows, volumes, and immersive spaces to teach people about the Earth
• Diorama - Design scenes for your visionOS app using Reality Composer Pro
• Swift Splash - Use RealityKit to create an interactive ride in visionOS
• Simulating physics with collisions - Create entities that behave and react like physical objects in a RealityKit view
• Simulating particles - Add a range of visual effects to a RealityKit view by attaching a particle emitter component to an entity

Resources

Articles

• VisionOS Development: Tips and Tricks - Tips and Tricks for Building Apple Vision Pro Apps
• Getting started with RealityKit - Series of articles about RealityKit
• RealityKit - Part of the book about RealityKit from kodeco
• Building an AR app with RealityKit - RealityKit dice AR game tutorial
• Introduction to RealityKit on iOS— Entities, Gestures, and Ray Casting - Introduction to RealityKit
• Introduction to RealityKit - Introduction to RealityKit from codingxr
• Create your first AR app with RealityKit and SwiftUI - Introduction to RealityKit
• How to animate AR objects with SwiftUI and RealityKit
• RealityKit on iOS, part 2 — applying collision events - Detect and Handle Collision Events in a RealityKit Scene Across Different Entities
• Evolution of Metal, ARKit, and RealityKit Sheet - This sheet shows the evolution of Apple frameworks - Metal, ARKit, and RealityKit
• Awesome visionOS - Awesome Apple visionOS related content

Apple

• RealityKit Overview - Overview
• RealityKit Documentation - Simulate and render 3D content for use in your augmented reality apps
• Understanding RealityKit’s modular architecture - Learn how everything fits together in RealityKit
• Building an Immersive Experience with RealityKit - Use systems and postprocessing effects to create a realistic underwater scene
• Designing RealityKit content with Reality Composer Pro - Design RealityKit scenes for your visionOS app
• Loading Entities from a File - Retrieve an entity from storage on disk using a synchronous or an asynchronous load operation
• Implementing systems for entities in a scene - Apply behaviors and physical effects to the objects and characters in a RealityKit scene with the Entity Component System (ECS)
• Creating 3D Content with Reality Composer - Assemble assets into a dynamic 3D composition that you can add to a scene in your app, or share with AR Quick Look
• Improving the Accessibility of RealityKit Apps - Incorporate assistive technologies in your augmented reality app
• Capturing photographs for RealityKit Object Capture - Take high-quality images of objects to generate 3D models
• Modifying RealityKit Rendering Using Custom Materials - Write Metal shader functions to implement custom rendering effects
• Designing Scene Hierarchies for Efficient Physics Simulation - Configure your RealityKit scenes to avoid performance bottlenecks
• Handling Different-Sized Objects in Physics Simulations - Set up a scene hierarchy for accurate physics simulations
• Improving the Performance of a RealityKit App - Measure CPU and GPU utilization to find ways to improve your app’s performance

WWDC

2023

• Explore rendering for spatial computing - Find out how you can take control of RealityKit rendering to improve the look and feel of your apps and games on visionOS
• Meet RealityKit Trace - Discover how you can use RealityKit Trace to improve the performance of your spatial computing apps
• Enhance your spatial computing app with RealityKit - Go beyond the window and learn how you can bring engaging and immersive 3D content to your apps with RealityKit
• Evolve your ARKit app for spatial experiences - Learn how ARKit and RealityKit have evolved for spatial computing
• Explore materials in Reality Composer Pro - Learn how Reality Composer Pro can help you alter the appearance of your 3D objects using RealityKit materials
• Build great games for spatial computing - Find out how you can develop great gaming experiences for visionOS
• Develop your first immersive app - Find out how you can build immersive apps for visionOS using Xcode and Reality Composer Pro
• Build spatial experiences with RealityKit - Discover how RealityKit can bring your apps into a new dimension
• Advanced Scene Understanding in AR - ARKit 3.5 and RealityKit provide new capabilities that take full advantage of the LiDAR Scanner on the new iPad Pro

2022

• Bring your world into augmented reality - Follow along as we demonstrate how you can use Object Capture and RealityKit to bring real-world objects into an augmented reality game

2021

• Explore advanced rendering with RealityKit 2 - Create stunning visuals for your augmented reality experiences with cutting-edge rendering advancements in RealityKit
• Dive into RealityKit 2 - Creating engaging AR experiences has never been easier with RealityKit 2

2020

• What’s new in RealityKit - RealityKit is Apple’s rendering, animation, physics, and audio engine built from the ground up for augmented reality

2019

• Building Collaborative AR Experiences - With iOS 13, ARKit and RealityKit enable apps to establish shared AR experiences faster and easier than ever
• Building Apps with RealityKit - Gain a practical understanding of RealityKit capabilities by developing a game using its easy-to-learn API
• Introducing RealityKit and Reality Composer - Architected for AR, RealityKit provides developers access to world-class capabilities for rendering, animation, physics, and spatial audio