Voice Assistant System with Object Detection Technology for Visually Impaired

Abstract

Navigation, object recognition, obstacle avoidance, and reading provide substantial obstacles for visually impaired people, impeding their independence and day-to-day functioning. Current solutions, including standard voice assistants and white canes, either offer little help or cause privacy issues since they rely too much on the cloud. In order to fully address these issues, we suggest an inventive offering an object detection system and voice assistant powered by Android to assist the blind with problems they face on a daily basis The system incorporates the Arduino Uno, YoloV7 for object detection, and Android for the camera module. The complete apparatus is small and light, making it easy to mount anywhere. The assessments are carried out in controlled settings that replicate situations that a blind person could face in the real world. The suggested device allows visually impaired people to be more accessible, comfortable, and able to navigate more easily than the white cane, according to the results. People with visual impairments sometimes struggle to traverse complicated situations effectively. It is also no easy assignment to assist them in becoming perceptive navigators. In ocular individuals, cognitive maps derived. The system finds potential obstructions in the user's path, calculates the user's trajectory, and provides navigational data. Two experimental scenarios have been used to assess the solution. While the data is currently insufficient to draw firm conclusions, it does show that the technology can effectively assist visually impaired individuals in navigating an unfamiliar built environment.