Skip to content
Castellan
Envoy's icon

Overview · Envoy

Read as

Envoy, which captions your voice chats in your language

How Envoy writes down what others say in your voice chats and translates it into your language on your NPU, with captions on its page and over your game, and keeps nothing said.

Article
4101
Applies to
Envoy 0.1.8
Last reviewed
For
For everyone
Written for Envoy 0.1.8. Envoy is at 0.1.9 now (1 small release since: what changed).

What Envoy does#

The lord's envoy spoke for the household at other courts, and carried their words back in the household's own tongue. Envoy does the same in your voice chats.

While you're in a call in Discord, TeamSpeak or Mumble, Envoy writes down what the others say, translates it into your language, and shows the captions on its page and over your game. It's live captions for deaf and hard-of-hearing players too.

Envoy holds an office of its own, the Envoy's, on every kind of PC. It comes with the Household license.

How it hears your calls#

Envoy listens only to the voice chat programs you choose, and only while one of them is in a call. It hears that program alone, never your microphone or the rest of the PC. While no call is on, it does nothing at all.

Nothing said is kept. No sound and no caption is written to disk, and a call's captions are gone when Envoy stops.

Where the work runs#

Speech is turned into text on your NPU (Snapdragon X, Intel Core Ultra or AMD Ryzen AI), or more slowly on the processor without one. The local AI translates each line, on your PC. See Where the work runs.

The first time, Envoy gets what it needs to hear voice chat and readies its speech model for your NPU. Its page shows how far along it is.

Translations are written by the local AI and can be wrong: names and game terms are kept as they are.

Try a caption#

On Envoy's page, Try a caption takes a line typed in any language and shows it captioned in yours. It works with no call on.

Its page#

Envoy's page is at http://envoy.localhost:22020/, and Open on its card in Castellan goes there. It shows whether Envoy is setting up, waiting for a call or listening, and the captions of the call so far. Clear empties them.

Its settings#

SettingDefaultWhat it does
Your languageWindows' languageThe language captions are shown in.
Voice chat programsDiscord, TeamSpeak, MumbleThe programs it captions, as Windows names them, up to 12.
Translate into your languageOnOff: captions stay in the language spoken.
Show captions over your gameOnA strip of captions on top of the game or call. Clicks pass through it. Off: captions show on its page only.

What it can't do#

  • It doesn't caption what you say, only what the others in the call say.
  • A game's own voice chat is captioned only when you add the game to Voice chat programs.
  • It needs 64-bit Windows (x64 or Arm) to hear voice chat.

Is this page right?

If something on it is wrong or out of date, tell us and we'll fix the page.

Still stuck? Write to support@castellan-software.com and mention article 4101. Every version of Envoy, and what changed in it, is in its release notes.