The R2T2 streaming speech recognition model and the T3PO translation model, both part of NetEase Youdao's Ziyue Live series, have claimed the top spots in their respective categories on Hugging Face, namely ASR (Automatic Speech Recognition) and translation. These innovative models are specifically tailored to tackle the challenges faced by real-time AI voice agents, facilitating the creation of parallel pipelines for real-time simultaneous interpretation. Upon their open-source release, they swiftly garnered attention and adaptation from the developer community. Third-party developers have successfully completed transplantation and quantization versions of these models, significantly expediting the deployment process for local Voice Agent toolchains.
