GoKawiilRobert Triggs / Android Authority
Add Android Authority on Google: Preferred Source Google Discover
TL;DR Pixel 11 can translate American Sign Language into English text in real time.
A new demo shows Google’s accessibility feature working outside its launch presentation.
Google is expected to bring sign-to-text translation to more Pixel models.
Google’s Pixel phones have never been the strongest hardware contenders, but software has long been where the lineup punches above its weight. The Pixel 11 live sign-to-text translation may be one of its most meaningful examples yet, and a new hands-on demo shows it working outside Google’s launch showcase.
We first covered the feature when Google announced the Pixel 11 series, which can use its front camera to translate American Sign Language (ASL) into written English. Now, a video shared on Reddit shows the feature keeping up with a user signing in front of the phone, with translated phrases appearing in Gboard.
The obvious question is why someone would sign rather than simply type, as a keyboard can be quicker for short messages.
That misses an important distinction. For many Deaf people, sign language is their primary language. Signing is not simply a slower way of typing English; it is how they naturally communicate. Google’s feature takes ASL and converts it into English text for anyone to read, much like translating spoken Spanish into written English.
The demo shows the phone processing signing continuously, rather than requiring manual entry. Google says its SL2T model considers hand, arm, torso, head, and facial movements to understand meaning.
... continue reading