The Eye-tracking – Brain computer interface AI-based Vietnamese spelling system for severe motor disabilities project proposes to build a large, standard database of ET signal data (eye tracking) and EEG (electroencephalography) signals which serve research to support communication for people with motor function injuries and research to build solutions using artificial intelligence to support Vietnamese communication based on control signals from ET and EEG signals.
The data acquisition tool’s main function is to receive two types of control signals from ET and EEG. The signal receiver devices will be connected directly to the signal receiver (user machine) and then transmitted to the monitoring machine (support machine). On the signal receiver, the virtual keyboard and the content the user wants to spell can be displayed. Data from the signal receiver, after being transmitted to the monitoring machine, will be synchronized in real time. On the monitoring machine, the tool allows the support person to view the list of existing data records, perform operations to add, update, and delete data records. At the same time, the support person can manage the data connection status and monitor configuration settings. Depending on the device’s hardware configuration, the support person can optionally turn on or off the device connection as well as display the connection status.
The system uses artificial intelligence to support Vietnamese communication based on ET and EEG signals. The system’s input is information showing brain and eye activity of the patient and the output is the Vietnamese sentence the patient wants to “say”. The system has analyzers for electroencephalographic signals and eye movement signals to obtain characteristics of each type of signal. These features, along with the results of a language generation model (using patient’s character input) are the input to the Combiner for analysis, calculation, and suggestion of Vietnamese sentence the patient wants to express. Patients will be able to choose from a set of suggested phrases or sentences suggested by a learning algorithm; This solution can assist patients who have difficulty communicating with normal speech to express the information they want to express effectively.
Project website: https://blife.ai/