Live translate on Meta Glasses
Used the gpt-realtime-translate model to live translate whoever is talking to me on meta glasses-- much faster than built in, more languages, and works fine even when someone is videocalling me on a laptop.
Core trick
Streams glasses microphone audio into gpt-realtime-translate, and swaps an LLM in a voice AI to realtime-1.5 for lower latency.
Description
Used the gpt-realtime-translate model to live translate whoever is talking to me on meta glasses-- much faster than built in, more languages, and works fine even when someone is videocalling me on a laptop. Also swapped out our LLM in Yelp's voice AI to use realtime-1.5 to reduce latency 200-500ms.