Google rolled out the Pixel 11 series today with a fresh accessibility tool that lets deaf and hard-of-hearing users sign directly into the phone camera. The feature converts American Sign Language into English text on the spot. It feeds the output straight into Gboard or Live Transcribe for messages, searches, or notes.
Digital Trends covered the announcement in detail. The system relies on a new model called SL2T developed by Google DeepMind. It processes video from the Pixel camera and turns signs into typed words without requiring the user to pause and type responses. The goal centers on natural two-way exchanges during in-person chats rather than one-sided listening aids.
Privacy protections keep the raw video on the device. The model tracks body keypoints locally and sends only those coordinates to servers for translation. The feed itself gets discarded afterward. DeepMind trained SL2T on more than 100,000 hours of data spanning over 50 sign languages. Testers checked performance for left-handed signers and one-handed use while holding the phone.
TechCrunch noted the expansion of Live Transcribe to handle ASL through the camera. The rollout starts with Pixel 11 devices and American Sign Language to English. Additional languages and hardware support arrive later. BGR highlighted how the same camera input now works inside Gboard for dictation-style signing.
Trusted Reviews pointed out the feature appears on the Pixel 11 Pro models alongside other AI updates. Google positions the tool as the first large-scale sign language AI to reach a consumer handset. Earlier efforts stayed in research labs or limited pilots.
The DeepMind blog explains the shift from lab prototypes to product integration. Users sign into the camera the way hearing people speak into voice dictation. Results appear as text wherever typing normally occurs. The company claims stronger benchmark scores than prior systems, though real-world tests in varied lighting or rapid casual signing remain limited in public data.
Mashable reported the broader Pixel 11 hardware context, including the Tensor G6 chip that runs these AI workloads. Pricing starts at $899 for the base model with 256GB storage. Availability begins immediately following the Made by Google event.
Industry observers note the move could reduce reliance on interpreters or text-only workarounds in spontaneous settings. Success will hinge on accuracy outside controlled conditions. Google plans iterative improvements based on user feedback once the feature spreads beyond the initial Pixel 11 launch.