We are seeking an experienced Unreal Engine Developer to work on a cutting-edge project
involving real-time audio streaming, MetaHuman integration, and lipsync capabilities. The ideal
candidate will be proficient in socket communication, audio handling, and integrating text and
audio responses with MetaHuman avatars.
Responsibilities:
- Real-Time Audio Streaming:
○ Implement a system where Unreal Engine streams live audio (from the
microphone) in Base64 format to a server via socket communication.
○ Receive responses from the server in the form of text or Base64-encoded audio
streams. - Audio Playback:
○ Ensure Unreal Engine can play the received audio responses seamlessly in real
time. - MetaHuman Integration:
○ Connect the system with a MetaHuman avatar in Unreal Engine.
○ Implement lipsync functionality, syncing the avatar’s mouth movements and
facial expressions with the real-time text streamed from the server. - Optimization and Testing:
○ Optimize performance to ensure low-latency communication and response.
○ Conduct testing to ensure smooth functionality across all components. - Collaboration:
○ Work closely with the backend team to ensure smooth integration of the socket
communication system.
○ Coordinate with designers and stakeholders to achieve desired visual and
interactive quality.
Requirements:
● Proven experience with Unreal Engine 4/5.
● Strong knowledge of socket programming and real-time communication protocols.
● Experience working with Base64 encoding for audio streams.
● Familiarity with MetaHuman Creator and MetaHuman rigging.
● Expertise in lipsync systems, including speech-to-text integration for real-time avatar
animation.
● Proficiency in programming languages such as C++ and Blueprints for Unreal Engine.
● Strong problem-solving skills and attention to detail.
● Ability to work independently and meet project deadlines.
Nice to Have:
● Experience with audio signal processing.
● Knowledge of speech-to-text technologies.
● Previous work on similar real-time audio or interactive avatar projects.
Deliverables:
● A fully functional Unreal Engine project with real-time audio streaming, MetaHuman
integration, and lipsync capability.
● Documentation on implementation and usage.
● Support for initial testing and troubleshooting.