AR/VR Developer
Build immersive virtual reality environments and augmented reality applications that overlay digital information onto the physical world — transforming education, training, healthcare, manufacturing, architecture, and entertainment.
An AR/VR Developer builds interactive three-dimensional experiences for virtual reality (VR), augmented reality (AR), and mixed reality (MR) platforms. VR immerses users in a fully synthetic digital environment (Meta Quest, PlayStation VR, Valve Index headsets); AR overlays digital content onto the real world viewed through a camera (Apple Vision Pro, Microsoft HoloLens, smartphones via ARKit/ARCore); MR combines physical and digital objects in real time, allowing digital objects to interact with the physical environment. The field sits at the intersection of real-time 3D graphics programming, game development, spatial computing, and user experience design. The dominant development platforms are Unity (C#, cross-platform, the most widely used engine for AR/VR) and Unreal Engine (C++/Blueprints, photorealistic rendering, preferred for high-fidelity experiences). WebXR is an emerging browser-based standard for delivering AR/VR experiences without requiring a native app download. Sri Lanka has a small but growing AR/VR community, primarily concentrated in the IT services and education sectors. Several Sri Lankan IT companies (Arimac Lanka, Axiata Digital, 99X Technology) have AR/VR practices serving international clients in training simulation, virtual showrooms, and educational content. The most mature domestic use cases are in education (virtual science labs, historical reconstructions), architecture and real estate (virtual property tours, BIM visualisation), healthcare training (surgical simulation, medical education), and industrial training (factory safety training, equipment maintenance simulation). Globally, the spatial computing market is being reshaped by the Apple Vision Pro (visionOS platform, released 2024) and the Meta Quest ecosystem (the dominant consumer VR platform); both represent significant new development opportunities. The field is genuinely at an early stage of mainstream adoption — developers who build expertise now will have compounding advantage as the installed base grows.
What a AR/VR Developer does daily
- Unity 3D application development — the majority of AR/VR professional work uses Unity with C#; creating scenes, game objects, and component-based architecture; physics simulation; UI systems (uGUI and UI Toolkit); animation systems (Animator, Timeline); audio management; asset pipeline management; Unity is the most productive path to AR/VR for developers with programming backgrounds
- VR interaction design and implementation — implementing controller input (Meta XR SDK, OpenXR standard, XR Interaction Toolkit); hand tracking; locomotion systems (teleportation, smooth locomotion, room-scale); grab and physics interaction; haptic feedback; comfort design to prevent simulator sickness; every VR interaction decision affects user comfort and immersion quality
- AR development on mobile (ARKit/ARCore) — Apple ARKit for iOS (LiDAR depth sensing, face tracking, image recognition, world tracking); Google ARCore for Android (motion tracking, environmental understanding, light estimation); AR Foundation in Unity for cross-platform mobile AR; these are the most widely deployed AR platforms because they require only a smartphone
- Microsoft HoloLens / Mixed Reality development — MRTK (Mixed Reality Toolkit) in Unity; spatial mapping; hand and eye tracking; hologram anchoring to real-world surfaces; enterprise use cases (industrial maintenance, remote assistance); the dominant enterprise MR platform in manufacturing and healthcare
- Apple Vision Pro / visionOS development — SwiftUI and RealityKit for visionOS applications; spatial windowing; volumetric apps; eye tracking and hand tracking input; spatial audio; the newest and highest-profile spatial computing platform; early developers have first-mover advantage
- Unreal Engine development — C++ and Blueprint visual scripting; Lumen (real-time global illumination) and Nanite (virtual geometry) for photorealistic rendering; MetaHuman Creator for realistic digital humans; preferred for architectural visualisation, film/TV virtual production, and high-end training simulation where visual fidelity is paramount
- WebXR development — building AR/VR experiences that run in the browser without a native app; A-Frame (HTML-based, the simplest WebXR framework); Three.js with WebXR API; Babylon.js; no app store distribution required; ideal for marketing, retail, and education use cases where frictionless access is important
- 3D asset pipeline and optimisation — creating or sourcing 3D models (Blender for modelling, Substance Painter for texturing); LOD (Level of Detail) optimisation; polygon budget management; texture compression; occlusion culling; draw call batching; the performance constraints of AR/VR (90fps minimum, 7ms frame budget at 90Hz) require significantly more aggressive optimisation than standard mobile development
- Spatial audio implementation — 3D positional audio using Unity Audio, Meta Spatializer SDK, or Resonance Audio; HRTF (Head-Related Transfer Function) for realistic directional audio; environmental reverb modelling; spatial audio is one of the strongest drivers of presence and immersion in VR
- Multiplayer and social VR — Photon Fusion or Mirror networking for shared VR spaces; avatar systems; voice chat integration (Vivox, Agora); synchronising physics objects across clients; the technical complexity of networked VR is significantly higher than single-player; emerging importance as enterprise collaboration in VR grows
Step-by-Step Career Roadmap
- Install Unity and complete the "Roll-a-Ball" tutorial — Unity's official beginner tutorial; teaches scene setup, scripting, physics, and build deployment in ~2 hours; available free on Unity Learn; this is the most widely recommended first Unity project
- Learn basic 3D with Blender — watch the Blender Guru "Donut Tutorial" (free YouTube, ~9 hours); creates a photorealistic donut from scratch; the most widely completed beginner 3D modelling project in the world; teaches modelling, materials, lighting, and rendering
- Experience VR — if possible, try a Meta Quest 2 or similar headset (available at Dialog Digital or Sri Lanka tech events); experiencing VR as a user builds intuition for what makes experiences comfortable and engaging; even YouTube 360-degree videos via smartphone cardboard headsets give a basic sense
- Learn the maths behind 3D — Khan Academy: "Vectors" and "Linear Algebra" introductory sections; understand what a vector is; what dot product and cross product compute geometrically; these concepts are used directly in every Unity script that moves or rotates objects
- C# basics — Microsoft's free "C# Fundamentals for Absolute Beginners" (Channel 9/YouTube); variables, loops, conditionals, functions; the programming foundation for Unity scripting
- Unity Learn: "Roll-a-Ball" tutorial (free)
- Blender Guru: "Donut Tutorial" complete run-through (YouTube, free)
- Unity Learn: "Create with Code" beginner pathway (free)
- Khan Academy: Vectors module (free)
- Microsoft Learn: "C# Fundamentals for Absolute Beginners" (free)
- Try a 360-degree VR video on YouTube with cardboard headset; reflect on what creates presence
- Do not skip the 3D mathematics — many Unity beginners treat Vector3, Quaternion, and Transform as black boxes that they use by copy-pasting from tutorials without understanding; this creates a ceiling on capability; developers who understand what transform.forward actually represents (the unit vector in the object's local forward direction) solve movement and rotation problems in minutes that take copy-paste developers hours