Perhaps one day anime will become a reality thanks to projects like this one from creator and developer Jess Peter.peter is raspberry pi Enhance a custom holographic animated virtual assistant named Maria It’s fully interactive and 100% adorable.
This holographic virtual assistant features an original 3D design with animations that help bring her to life. Peter has implemented her AI for speech recognition and programmed text-to-speech so Maria can interact with the user to complete her verbal requests and initiate tasks. Maria is still in development, so features are limited, but she plans to add more features in the future.
Peter provides a lot of juicy details about her work and how to set it up yourself at home. You can set it up (“beep! beep! beep!”), and even use the Spotify API to play music.
This project is running on a Raspberry Pi 4B connected to a USB microphone for audio input and a USB speaker for audio output. The Pi is housed in a 3D printed case with a conical acetate sheet attached to give it a holographic effect. It uses a small 3.2 inch screen to project images with a resolution of 800 x 400 pixels.
Diving into the software side, Maria uses a Python server that constantly listens for audio input. Keywords are detected using her Webrtvt and Deepspeech and are used to determine incoming commands. The text-to-speech functionality is handled using C with Google’s text-to-speech library. A shader is needed to warp the character on screen so that it appears correctly on the acetate cone.For more information about the project, you can read more on the official GitHub page.
This Raspberry Pi project is very impressive and I urge anyone considering recreating it to check out the official website. Peter was kind enough to share all the details we needed. Maria to your home.
