AR Object Detection in Unity + Lightship (Tutorial)
Thanks for watching my journey. I want to build the most exciting AR Experiences including games, movies and productive apps. My background is mainly in 2D / 3D Animation using Blender and After Effects, but I always loved the idea auf Augmented Reality. Furthermore I liked to code. So in late 2022 I decided to learn Unity and get deeper into AR Software Development. Let’s see how far we can come 🙂
I have a new AR Asset for Unity, which will make your life easier creating any kind of AR Game. There is a free “lite” version too:
Find the AR Magic Bar here*: https://assetstore.unity.com/packages/tools/utilities/ar-magic-bar-ar-foundation-lightship-3d-284853?aid=1100lumXw
And the AR Magic Bar Lite: https://assetstore.unity.com/packages/tools/utilities/ar-magic-bar-lite-ar-foundation-lightship-3d-295650
Timestamps
00:00:00 Introduction
00:00:30 Quick Setup
00:02:00 Log detections to console
00:16:00 Adding rectangle indicators
00:37:00 Spawn Objects
Code for this tutorial:
https://github.com/Alive-hub/Lightship-Object-Detection
Object Detection documentation:
https://lightship.dev/docs/ardk/features/object_detection/
Lightship ARDK Sample Package (Includes an invisible shadow catcher for the built in pipeline):
https://lightship.dev/docs/ardk/sample_projects/
Video Tutorial for installing Lightship:
Lightship documentation:
https://lightship.dev/docs/ardk/setup/
Templates for playback (In editor testing with video):
https://drive.google.com/drive/folders/1vS9mHet8JYzekdEmvQa1riYwANRPwAL3?usp=drive_link
My Lightship ARDK 3 Playlist:
Niantic Wayfarer App:
https://testflight.apple.com/join/VXu1F2jf
https://play.google.com/store/apps/details?id=com.nianticlabs.argeo.niamapapp&pli=1
3D Assets that are great for AR purposes:
(The given links are part of Unity’s affiliate program and help support the channel at no extra cost)
Shadow catchers for URP:
URP Shadowcatcher (Free)
https://prf.hn/click/camref:1100lumXw/destination:https://assetstore.unity.com/packages/vfx/shaders/shadow-receiver-urp-free-228074
URP Shadowcatcher:
https://assetstore.unity.com/packages/vfx/shaders/shadow-receiver-urp-directional-additional-light-shadows-228069?aid=1100lumXw
URP Water Shader:
https://assetstore.unity.com/packages/vfx/shaders/stylized-water-2-170386
URP Grass Shader:
https://assetstore.unity.com/packages/vfx/shaders/brute-force-grass-shader-192388
Beautiful, Low-Poly Packs:
Low Poly Hummingbird, Animated:
https://prf.hn/click/camref:1100lumXw/destination:https://assetstore.unity.com/packages/3d/characters/animals/birds/low-poly-bird-hummingbird-199904
Low Poly, Animated Dinosaurs:
https://assetstore.unity.com/packages/3d/characters/animals/low-poly-animated-dinosaurs-110313?aid=1100lumXw&pubref=AliveStudios
Low Poly, Animated Animals:
https://assetstore.unity.com/packages/3d/characters/animals/poly-art-animal-forest-set-128568?aid=1100lumXw&pubref=AliveStudios
Low Poly Jungle:
https://assetstore.unity.com/packages/3d/environments/fantasy/polygon-tropical-jungle-nature-biomes-low-poly-3d-art-by-synty-234253?aid=1100lumXw
Low Poly Forest:
https://assetstore.unity.com/packages/3d/vegetation/trees/polygon-nature-low-poly-3d-art-by-synty-120152?aid=1100lumXw&pubref=Alive_Studios
Fantasy Kingdom:
https://assetstore.unity.com/packages/3d/environments/fantasy/polygon-fantasy-kingdom-low-poly-3d-art-by-synty-164532?aid=1100lumXw
Dungeon Realms:
https://assetstore.unity.com/packages/3d/environments/dungeons/polygon-dungeon-realms-low-poly-3d-art-by-synty-189093?aid=1100lumXw&pubref=AliveStudios
Modern City Pack:
Explorer Character Pack:
https://assetstore.unity.com/packages/3d/characters/humanoids/humans/polygon-explorer-low-poly-3d-art-by-synty-128996?aid=1100lumXw
VFX ( Particles, Fire, Magic, Smoke etc.)
Epic Toon VFX
https://assetstore.unity.com/packages/vfx/particles/epic-toon-fx-57772?aid=1100lumXw&pubref=AliveStudios
Convert Terrain to Mesh (For Transforming a Terrain to view in AR):
https://assetstore.unity.com/packages/tools/terrain/terrain-to-mesh-195349?aid=1100lumXw
source