Indian Sign Language / English / हिंदी
Talk between sign language and speech.
Sign to your camera and Convora says it out loud. Speak or type a reply, and it shows the signs. One conversation, in both directions.
A final-year project. Sign recognition knows 126 ISL signs and works best with your head, hands and waist in view. It does not replace a qualified interpreter.
- ISL signs recognised from video
- 126ISL signs recognised from video
- spoken languages: English and Hindi
- 2spoken languages: English and Hindi
- sentences spoken before you confirm them
- 0sentences spoken before you confirm them
- until uploaded videos and audio are deleted
- 48 huntil uploaded videos and audio are deleted
How it works
How a conversation works
Five steps, and you stay in control of what gets said.
- 01
Sign to the camera
Record a short clip in the chat. Sit back so your head, hands and waist are in the picture; an outline shows where.
- 02
Convora recognises the sign
MediaPipe finds your hands and body. A model trained on the INCLUDE dataset picks one of 126 ISL signs, and simple hand shapes such as yes, no and numbers are read directly.
- 03
You check it
You see the sentence and how sure Convora is. When it is not sure, you pick the right word first; nothing is said without you.
- 04
It is spoken aloud
The hearing person hears the sentence in English or Hindi, and the chat keeps a written copy for both of you.
- 05
Replies come back as signs
Spoken or typed replies, in English or Hindi, are shown as signs from the official ISL dictionary, with words spelled out where no sign exists.
Ways to use it
Three ways to take part
Each person uses what suits them. Everything ends up in the same conversation.
Sign
Record yourself signing, check the result, and Convora speaks it.
- Record in the chat or upload a short clip
- An outline shows how to sit in front of the camera
- 126 trained signs, plus simple hand shapes
- Nothing is spoken until you are happy with it
Speak
Talk into the microphone and the words appear as ISL signs.
- English or Hindi speech
- Whisper writes down what you said
- Fix the text before it is signed
- Signs from the official ISL dictionary
Type
Write a message instead, in English or Hindi, and see it as signs.
- On-screen Hindi keyboard
- Enter to send, Shift+Enter for a new line
- Conversations are saved to your account
- Works with a keyboard and screen readers
What we are careful about
Limitations About the Project
Sign languages are languages
ISL has its own grammar and regional variation, and it is not English word by word. Convora shows signs in a simplified ISL order: it is a helper, not a full translator.
Honest about what it sees
Much of sign grammar is in the face, head and shoulders. Convora reads hands and body position, not facial expressions yet, so signs that depend on them can be missed.
You decide what is said
Lighting, camera angle and signing style all affect recognition. When Convora is unsure, it asks you to pick or correct the sentence before anything is spoken.
Accessible to use
Keyboard navigation (Escape closes dialogs), labelled controls for screen readers, a high-contrast mode and a reduced-motion mode.
Try it with someone.
Open the chat, then sign to your camera, speak into the microphone or type. Every message can be shown in sign language or spoken aloud.