AR / Unity Developer to $3000 Offline

(Face Tracking & Markerless Earrings Try-On)
Format: Freelance
Estimated workload: ~100–120 hours

Project Overview

We are extending an existing Unity-based iOS AR application with a markerless earring try-on feature.

The application already supports marker-based AR jewelry try-on. The new functionality will scan the user’s face and place earrings on the ears in real time, with a strong focus on stable anchoring, accurate positioning, and realistic rendering.

3D earring models are loaded dynamically from an existing backend.
The work involves Unity, ARKit, and ML-based face landmark tracking (e.g. MediaPipe), suitable for real-world jewelry retail use.

Responsibilities

• Implement markerless, face-based earring try-on in an existing Unity iOS app.
• Integrate and tune face landmark tracking (e.g. MediaPipe) for stable earring anchoring.
• Combine ML-based facial landmarks with ARKit head pose for accurate positioning and rotation.
• Ensure smooth, realistic real-time rendering and basic physics for earrings.
• Optimize performance, stability, and memory usage on iOS devices.

• Collaborate closely with the product team during R&D and iteration phases.

   

Required Skills (Must-Have)

1. Unity

• 5+ years of professional experience with Unity 3D and C#.
• Production experience with AR Foundation.
• Strong understanding of:
  • coordinate systems & transformations
  • quaternions
  • camera calibration

• Mobile optimization expertise (rendering, shaders, assets, memory).

   

2. ARKit (iOS)

• Hands-on experience with ARKit face tracking.
• Clear understanding of ARKit limitations (e.g. lack of ear landmarks) and how to build custom logic on top of head pose.
• Experience with iOS camera pipelines.

• Experience with native iOS plugins (Swift / Objective-C) - optional but desirable.

   

3. Computer Vision / Machine Learning (Practical)

• Experience integrating MediaPipe Face Mesh or similar landmark models.
• Ability to work with 468 3D face landmarks, map them into Unity, and stabilize noisy data.
• Practical understanding of:
  • smoothing filters (EMA, Kalman)
  • pose estimation
  • occlusion & segmentation basics
  • facial geometry

• Ability to merge ARKit pose data with ML-based landmarks.

   

4. iOS Integration

• Experience building Unity apps for iOS.
• Ability to integrate native iOS code with Unity when ML runs natively.
• Knowledge of Metal - optional but valuable.

5. 3D & Graphics

• Solid understanding of:
  • PBR materials (especially metals & gemstones)
  • lighting models
  • anchoring 3D objects to body parts
  • basic animation (e.g. dangling earrings)

• Experience with physically-based rendering and realistic reflections.

   

6. Architecture & Production Experience

• Ability to design clean flows for:
  • receiving 3D models from backend
  • dynamic loading
  • caching & performance optimization
• Experience delivering full-cycle features in mobile products.