Posted by Thomas Ezan – Sr Developer Relation Engineer (@lethargicpanda)
We’re excited to announce Gaze Hyperlink because the winner of the Finest Android App for our Gemini API Developer Competitors!
This modern app demonstrates the potential of the Gemini API in offering a communication system for people with Amyotrophic lateral sclerosis (ALS) who develop extreme motor and verbal disabilities, enabling them to kind sentences with solely their eyes.
About Gaze Hyperlink
Gaze Hyperlink makes use of Google’s Gemini 1.5 Flash mannequin to foretell the person’s meant sentence based mostly on a couple of key phrases and the context of the dialog.
For instance if the context is “Is the room temperature okay?” and the person replies “scorching AC two” the app will leverage Gemini to generate the total sentence “I’m scorching, are you able to flip the AC down by two levels?”.
The Gaze Hyperlink workforce took benefit of Gemini 1.5 Flash multilingual capabilities to let the app generate sentences in English, Spanish and Chinese language, the three languages presently supported by the app.
We had been actually impressed by the Gaze Hyperlink app. The workforce used the Gemini API mixed with ML Package Face Detection to empower people with ALS offering them with a robust communication system that’s each accessible and inexpensive.
With Gemini 1.5 Flash presently supporting 38 languages, it’s attainable for Gaze Hyperlink so as to add help for extra languages sooner or later. As well as, the mannequin’s multimodal skills may allow the workforce to boost the person expertise by integrating picture, audio and video to enhance the context of the dialog.
Construct with the Gemini API
The results of the mixing of the Gemini API in Gaze Hyperlink is inspiring. In case you are engaged on an Android app at present, we encourage you to study concerning the Gemini API capabilities to see how one can efficiently add generative AI to your app and delight your customers.
To get began, go to the Android AI documentation!