Raspberry Pi Pico Generates Speech Using Hand Gestures
If there is one raspberry pi What I am good at is bridging connections. I often see models like the Raspberry Pi Pico used to manufacture things like adapters. Today I put together a demo of a great project. SVSembedded It bridges the communication gap between people, not between devices. They used the Raspberry Pi Pico to create a system that allows speech-impaired users to relay messages using hand gestures.
This project enables communication using flex sensors. These are bendable sensors that send a signal when they are bent. Pico is responsible for taking these signals from sensors and sending corresponding messages from a pre-programmed list of words and phrases. The user needs to know which flex sensor combination conveys what they want to communicate. The user is somewhat limited by the list, but you can easily extend it with different modes.
SVSEmbedded puts the flex sensor inside the glove. In this way, all a user needs to do to communicate is to bend their right finger or fingers to communicate. Pico is connected to a speaker and a small screen, so when a message is relayed it will be repeated on the speaker and read on the display.
Several modules are involved in creating this project. It is powered by a Raspberry Pi Pico connected to three separate flex sensors. A 16 x 2px LCD display panel is used for text output along with several LEDs for indicators. APR33A3 audio module is used to output audio to speakers.
Unfortunately, SVSEmbedded didn’t delve too deeply into the software side of the project. Although the details are limited, we believe this can be easily reproduced using MicroPython. If you can read the input from the flex sensor and program the corresponding response, then you’re good to go.
If you want to recreate this Raspberry Pi project, check out the original video shared. YouTube Let’s take a closer look at how SVSEmbedded components work together. Be sure to follow us for more cool projects.