EMOJO Mental Health Chatbot

May 2021

Purpose

Nearly 1 out of 5 people are suffering from some kind of Mental Health Issues, these numbers have drastically increased since the start of pandemic. According to researchers watching a movie/series helps for Mental Health. It has huge impact on our brain function, social connections, productivity and creativity. And having your close people near you to understand your problems you is difficult during this pandemic.

To solve this issue I have created a Visual Chatbot which responds with Voice and Emotions. This chatbot will help Users as a Virtual Friend which will chat with him/her and also show his emotions with help of Emojis. Currently there is no such device which helps user in this way. To have a similar language as Movie/Series we have used dialouges from F.R.I.E.N.D.S TV Series for our Chatbot ,which will help user for more easy and amusing conversation. Also with this we have also analysed Emotions from Text and displayed respective emojis on Screen for better visual conv.

Technology Stack

• We have used Raspberry Pi and TFT Display to make the project.
• For Chatbot we have used Python, NLTK and for Dataset we have used F.R.I.E.N.D.S Corpus which contained all dialouges.
• For Emotions we scraped Emoji Images from Google Search and the emojis were predicted using Text Classification Model.
• For the TFT Display we have use Adafruit_ILI9341 Library to create the GUI.
• For Voice Recognition , we used Bluetooth Headset to take the Input Voice from User and use Google Cloud Speech API of speech_recognition package for Speech to Text.
• And for Text to Speech from Chatbot we used pyttsx package.

Learnings

Github Repo