Gesturify

Gesturify AI is a privacy-first, real-time assistive communication platform designed to bridge the communication gap between people who use Indian Sign Language (ISL) and people who do not understand it.

The platform enables bidirectional communication. It can recognize real-time ISL hand and upper-body gestures through a webcam and convert them into meaningful English/Hindi text and speech. In the reverse direction, spoken language can be converted into animated ISL gestures using a procedural skeletal avatar.

Gesturify AI combines MediaPipe Vision, ONNX Runtime Web, custom 3D geometric gesture recognition, procedural skeletal animation, and Web Speech APIs to perform processing directly in the browser. This edge-first approach reduces latency, avoids the need for cloud GPU processing, and keeps camera video on the user's device.

Beyond translation, Gesturify includes an ISL learning studio, A–Z fingerspelling guides, interactive grammar learning, video-based lessons, and camera-based quizzes, making it both a communication tool and an educational platform.

By combining accessibility, real-time AI vision, bidirectional translation, and privacy-focused edge computing, Gesturify AI aims to make everyday communication and ISL learning more accessible, interactive, and inclusive.