Google's AI lab has launched a large-scale multilingual sign language-to-text translation model, marking the first application of sign language AI in consumer-grade products. The Gboard and Live Transcribe apps on Google's Pixel 11 series now support American Sign Language (ASL) to text input, with plans to expand support for more sign languages in the future. Trained on over 100,000 hours of data from more than 50 sign languages, the model requires powerful computer vision processing capabilities to recognize synchronized movements of multiple body parts of the user. It directly interprets spatial information and protects user privacy by transforming pose feature point locations, eliminating the need to transmit raw video streams. This technology offers a flexible typing alternative similar to voice input for approximately 70 million hearing-impaired individuals worldwide. Tests show that ASL input is more efficient and natural than English typing.
