Indian Sign Language / English / हिंदी

Talk between sign language and speech.

Sign to your camera and Convora says it out loud. Speak or type a reply, and it shows the signs. One conversation, in both directions.

How it works

A final-year project. Sign recognition knows 126 ISL signs and works best with your head, hands and waist in view. It does not replace a qualified interpreter.

ISL signs recognised from video
126ISL signs recognised from video
spoken languages: English and Hindi
2spoken languages: English and Hindi
sentences spoken before you confirm them
0sentences spoken before you confirm them
until uploaded videos and audio are deleted
48 huntil uploaded videos and audio are deleted

How it works

How a conversation works

Five steps, and you stay in control of what gets said.

  1. 01

    Sign to the camera

    Record a short clip in the chat. Sit back so your head, hands and waist are in the picture; an outline shows where.

  2. 02

    Convora recognises the sign

    MediaPipe finds your hands and body. A model trained on the INCLUDE dataset picks one of 126 ISL signs, and simple hand shapes such as yes, no and numbers are read directly.

  3. 03

    You check it

    You see the sentence and how sure Convora is. When it is not sure, you pick the right word first; nothing is said without you.

  4. 04

    It is spoken aloud

    The hearing person hears the sentence in English or Hindi, and the chat keeps a written copy for both of you.

  5. 05

    Replies come back as signs

    Spoken or typed replies, in English or Hindi, are shown as signs from the official ISL dictionary, with words spelled out where no sign exists.

Ways to use it

Three ways to take part

Each person uses what suits them. Everything ends up in the same conversation.

For Deaf and signing users

Sign

Record yourself signing, check the result, and Convora speaks it.

  • Record in the chat or upload a short clip
  • An outline shows how to sit in front of the camera
  • 126 trained signs, plus simple hand shapes
  • Nothing is spoken until you are happy with it
For hearing users

Speak

Talk into the microphone and the words appear as ISL signs.

  • English or Hindi speech
  • Whisper writes down what you said
  • Fix the text before it is signed
  • Signs from the official ISL dictionary
For anyone

Type

Write a message instead, in English or Hindi, and see it as signs.

  • On-screen Hindi keyboard
  • Enter to send, Shift+Enter for a new line
  • Conversations are saved to your account
  • Works with a keyboard and screen readers

What we are careful about

Limitations About the Project

Sign languages are languages

ISL has its own grammar and regional variation, and it is not English word by word. Convora shows signs in a simplified ISL order: it is a helper, not a full translator.

Honest about what it sees

Much of sign grammar is in the face, head and shoulders. Convora reads hands and body position, not facial expressions yet, so signs that depend on them can be missed.

You decide what is said

Lighting, camera angle and signing style all affect recognition. When Convora is unsure, it asks you to pick or correct the sentence before anything is spoken.

Accessible to use

Keyboard navigation (Escape closes dialogs), labelled controls for screen readers, a high-contrast mode and a reduced-motion mode.

Try it with someone.

Open the chat, then sign to your camera, speak into the microphone or type. Every message can be shown in sign language or spoken aloud.