MODELS AND MODALITIES

Custom vocabulary needs an audio-backed correction test

Event source: Gemini 3.5 Transcribe adds intelligent transcription paths ↗

In this analysis
THE RETROSPECTIVE TAKE

A vocabulary hint is recognition context, while the recording remains the evidence for which term was spoken.

Recognition hints became part of the input

Gemini 3.5’s May 19, 2026 launch preceded Live Translate on June 9. The August 26 Transcribe announcement included custom vocabulary support. Such hints can help when a recording contains unfamiliar names or specialized spelling. They also change the evaluation boundary. A preferred term in the prompt is not evidence that the speaker actually said it. The useful question is whether context improves recognition without replacing the acoustic evidence with the evaluator’s expectation.

Similar terms need contrasting cases

An illustrative product catalog contains names that sound alike but refer to different variants. A vocabulary list can make the relevant spelling available to the recognizer. If the test includes only recordings of the expected term, an apparent improvement can conceal over-insertion of that term elsewhere. The evaluation therefore needs contrasting audio where a similar ordinary word or another variant is spoken. This is a test-design recommendation, not a claim that the model always follows a hint or that custom vocabulary overrides its recognition in a particular undocumented way.

Scope matters as much as spelling

A broad organization-wide vocabulary may include many unrelated terms. A task-specific list can reduce irrelevant expectations, but it must still reflect the permitted recognition contract. More hints do not automatically supply more useful information. The relevant context may be a particular project, product family or document currently discussed. A reviewer should preserve the vocabulary used for a test so that a later accuracy comparison can distinguish a model change from a changed input. Otherwise improved output may simply reflect a better-prepared prompt.

An audio-backed correction fixture

A practical illustrative dataset pairs recordings of the target term with near-neighbor terms and ordinary speech. Compare outputs with the same bounded vocabulary context and inspect both corrected recognition and newly introduced substitutions. Retain the audio segment supporting each disputed word. No word-error rate or product ranking is asserted. The fixture avoids treating a transcript as correct merely because it contains the desired identifier. It also checks that a successful spelling correction remains attached to the right utterance rather than being inserted in a nearby but unrelated sentence.

Hints assist evidence rather than become evidence

The release makes specialized transcription easier to explore, but vocabulary support should not turn recognition into completion of an expected answer. The retrospective lesson is to evaluate helpful corrections together with false substitutions. A useful hint narrows interpretation where the audio supports it; it does not establish a fact absent from the recording. Keeping the prompt context and audio traceable makes the result explainable and gives a precise way to improve a domain vocabulary without claiming that every preferred term will be recognized correctly.

← All retrospectives