Technology Overview
AI Sign Language Broadcaster.
To alleviate the shortage of sign language interpreters and enhance information accessibility, ITRI has created the AI Sign Language Broadcaster and collaborated with Taiwan’s Public Television Service on TV weather broadcasting. This technology uses a large language model to translate spoken text into sign language. A model measures the skeletal movements of the hands and body to ensure fluency and accuracy, presenting natural and grammatically correct sign language expressions. Gen AI is used to convert these skeletal movements into animations of an anchor avatar performing sign language.
Applications & Benefits
This allows the Deaf community to see expressive sign language interpretations in real time, including emergency information such as disaster alerts. This innovation improves communication and cultural equity, helping to foster an inclusive and resilient society.