Unreal Engine Developer (Web-Based Educational Platform)

Requirements:

  • 5+ years of experience with Unreal Engine 4/5, with deep knowledge of C++ gameplay systems and Blueprint scripting.
  • Strong background in Unreal Engine Web deployment (e.g., Pixel Streaming, WebRTC, WebAssembly/Emscripten builds).
  • Proficiency in API integration within Unreal (REST/HTTP requests, JSON serialization/parsing, WebSockets).
  • Experience with real-time audio processing inside Unreal: microphone input capture, Text-to-Speech (TTS)playback, Speech-to-Text (STT) pipelines, and lip-sync/phoneme-based animation.
  • Solid understanding of Animation Blueprints, Live Animation Playback, Sequencer, and Control Rig for real-time character animation.
  • Familiarity with third-party SDK integration into Unreal (AI, biometrics, or educational technology SDKs).
  • Proven skills in low-latency system optimization: network sync, audio/animation pipeline tuning, and Unreal performance profiling (Stat commands, Unreal Insights, GPU/CPU profilers).
  • Strong problem-solving ability and experience building scalable interactive systems.
  • (Nice-to-have) Experience in serious games, edtech applications, or interactive training simulations.
  • (Nice-to-have) Familiarity with emotion recognition, gaze tracking, or AI-driven character behavior systemsintegrated with Unreal.
  • Upper-intermediate on Advanced English or French proficiency.
     

Responsibilities:

  • Implement real-time communication between Unreal Engine client and Python backend (REST APIs, WebSockets), handling JSON-based lesson data, animation keyframes, and student progress updates.
  • Integrate microphone input into the Unreal Engine runtime for speech capture and recognition.
  • Implement TTS playback within Unreal with synchronized lip-sync and facial animation via Animation Blueprints / MetaHuman Face AR.
  • Receive animation data (key sets, skeletal poses, blendshapes) from backend and render them through Sequencer or real-time animation playback.
  • Ensure audio-visual synchronization: align speech, gestures, and expressions for natural teacher–student interaction.
  • Optimize Unreal for browser/streaming environments (memory footprint, bandwidth usage, latency).
  • Profile and optimize rendering, animation, and networking pipelines for smooth interaction on both desktop and cloud-streamed clients.

 

Project description: 

We are building an AI-powered educational platform that combines Unreal Engine’s real-time animation with AI-driven teaching assistants. Students interact with a virtual teacher avatar that responds via speech, gestures, and animations in real-time. Unlike traditional games, this project emphasizes web deployment, low-latency interactions, and AI integration rather than core gameplay mechanics.
The platform includes:
 

  • 3,000+ grammar exercises, 500 retention checks, 200 dictations, and 300 instructional videos.
  • Real-time progress tracking, attention-level monitoring with BioTrack technology, and adaptive lesson planning.
  • Multi-modal student interaction (voice, selections, handwriting, keyboard input).
  • An engaging gamified learning journey, awarding badges and recognition for mastery.
     

Our mission: to revolutionize language learning with technology that enhances teaching efficiency, makes grammar more engaging, and adapts to every learner’s needs.

Required skills experience

Unreal Engine C++ 5 years
API REST 3 years

Required languages

English B2 - Upper Intermediate
Unreal Engine 5, Git, Windows Server
Published 5 September · Updated 15 September
Statistics:
63 views
·
6 applications
100% read
·
100% responded
Last responded 3 days ago
63 views
·
6 applications
To apply for this and other jobs on Djinni login or signup.
Loading...