In this article
Relabeling a waveform's sample rate is not resampling, and concatenated speech spans need an offset map back to the recording.
Voice activity detection depends on correct audio sampling and timestamp mapping before it can safely remove silence. Feeding samples at the wrong declared rate changes their interpreted duration, while careless remapping of retained speech can shift every downstream transcript citation away from the original recording.
Verify the actual input rate
The official Silero VAD repository documents supported input rates, including 8000 and 16000 Hz. The rate parameter must describe the samples actually supplied. Relabeling a waveform is not resampling it. Inspect decoded rate, channel layout and duration before calling the detector, and keep the conversion record so a surprising boundary can be traced to input preparation rather than assumed to be a model error.
Resample as an explicit transformation
The FFmpeg resampler documentation describes audio conversion machinery. Preserve the relationship between original and processed time, including any trimming or concatenation. Converting stereo to mono also changes the input and may affect audibility when channels contain different speakers. Do not assume that every mono conversion preserves every voice equally. Inspect a short multichannel fixture before applying the policy to an entire recording collection.
Test boundary-sensitive speech
Choose a phrase with a quiet initial consonant, a pause and a short final word. Listen around the proposed VAD boundaries. The useful question is whether answer-bearing speech survives, not merely how much silence disappears. Retain padding according to the application and inspect clipping rather than treating the detector’s output boundary as an exact phonetic segmentation of the spoken words.
| Transformation | Required check |
|---|---|
| Declared sample rate | Matches actual waveform samples |
| Resampling | Duration and time mapping remain coherent |
| Channel conversion | Important voices remain audible |
| Speech trimming | Quiet boundary words survive |
Preserve source time through transcription
The faster-whisper repository documents integrated VAD use. If an application separately concatenates speech spans, store their original offsets. A transcript time in the shortened signal cannot be used directly as a recording citation. Keep the segment map and apply it when constructing playback links. Otherwise a transcription can be textually correct while every later search result opens the wrong audio position.
Evaluate omissions and savings separately
Compare transcriptions around detected boundaries and review short utterances, quiet speech and overlapping voices. Report omitted speech separately from reduced processed duration. More aggressive silence removal is not automatically better recognition. The acceptance artifact should include waveform metadata, conversion settings, speech spans and source-time mapping. This makes VAD a controlled preprocessing step rather than an invisible operation that changes what evidence survives and where downstream tools believe it occurred.
Related reading: Long audio with Whisper: segments, queues and durable results; Whisper on CPU or GPU: comparing completion time and cost.