Sign Language Recognition and Translation System Using Machine Learning and Computer Vision
This project presents a smart Sign Language Recognition and Translation System designed to reduce the communication gap between sign language users and non-sign language users. The system supports two-way communication by converting text and speech into sign language and translating sign language into text and speech. It uses machine learning and computer vision techniques to recognize hand signs and gestures in real time. YOLOv8 is used for sign alphabet detection, while MediaPipe is used for hand landmark tracking and gesture analysis. The system also stores gesture patterns and hand angle data in JSON format for sentence-level recognition. A Flask-based web interface is used to provide an interactive and user-friendly experience. This project offers a practical solution for real-time communication, accessibility, and learning support.
Quick overview
This project presents a smart Sign Language Recognition and Translation System designed to reduce the communication gap between sign language users and non-sign language users. The system supports two-way communication by converting text and speech into sign language and translating sign language into text and speech. It uses machine learning and computer vision techniques to recognize hand signs and gestures in real time. YOLOv8 is used for sign alphabet detection, while MediaPipe is used for hand landmark tracking and gesture analysis. The system also stores gesture patterns and hand angle data in JSON format for sentence-level recognition. A Flask-based web interface is used to provide an interactive and user-friendly experience. This project offers a practical solution for real-time communication, accessibility, and learning support.