Android gets option to control interface with facial expressions

Android may get an option in Accessibility to control the interface with just facial expressions. For example, users can link actions to, for example, a smile or raising their eyebrows.

The options are in the Accessibility Tools beta, XDA-Developers discovered. The options seem to be intended for people who have difficulty with normal touch screen operation and come in addition to other control methods, such as voice commands. Unlike voice commands, the new options work without speaking, which can be useful in public places, for example.

The option to use the front camera is included in the options to connect an accessory via USB or Bluetooth to take over operation of the touchscreen. There are a total of six facial expressions and fourteen actions to choose from. For each expression you can set how sensitive the software reacts.

XDA got the options working in Android 11 and Android 12. In the latest version, a pixel lights up at the top of the screen to indicate that the front camera is in use. The option is not intended for general use. The effect of the function on battery life is unclear. Google hasn’t announced the feature publicly yet.

Images: XDA-Developers

Android Accessibility – Facial Expression Options
Expressions Actions
open mouth Selecting Home
Smile Next one Back
Raising eyebrows Previous Notifications
Looking to the left Long press Quick Settings
Look to the right Scroll forward Overview
Look up Scroll back Pause face recognition function