TECHNOLOGY

Gemma 4 thinking mode and empty thought blocks

In this article
THE QUICK TAKE

An empty Gemma thought block can be supplied by the template rather than generated as an active reasoning trace.

An empty thought block in a Gemma 4 response does not necessarily mean the model ignored a request to disable thinking. Some Gemma 4 templates intentionally include an empty channel boundary to stabilize non-thinking output.

Read the version-specific behavior

The thinking guide documents enable_thinking and different prompt shapes across model sizes. The 26B-A4B card also explains thought-channel behavior. The formatting guide defines the model’s control tokens.

For 12B, 26B and 31B, the guide describes an empty thought prefix when thinking is off. E2B and E4B use a different off-mode prompt shape. The distinction is tied to the selected model and template, not a universal rule for every Gemma checkpoint.

Separate prompt prefix from generated response

A decoder output may be examined together with its input prefix or only after the input token boundary. If the template already supplied an empty thought block, a combined text dump can show it even when the model did not generate a reasoning trace.

That makes input slicing important. Do not infer active reasoning just from seeing a thought marker in a full decoded sequence. Compare the prompt tokens, newly generated tokens and parsed final answer as separate objects.

Use a small diagnostic table

ObservationWhat to inspect
Empty thought before answerWas the block already in the template?
Nonempty reasoningWas thinking enabled for the actual request?
Marker shown to userDid display parsing preserve control text?
Missing final contentWas generation incomplete or parsing destructive?
Different size behaves differentlyDoes its documented off-mode shape differ?

A simple factual or checked arithmetic prompt is sufficient for this format test. It should not be presented as a broad evaluation of reasoning quality.

Avoid deleting the final answer

A parser that removes everything after a thought opening marker can discard the final response. A parser that assumes all model sizes share one exact prefix can also mis-handle a valid off-mode output.

Use the documented channel boundaries and the selected processor’s parsing behavior. Keep raw output during diagnosis so that a missing display answer can be distinguished from a model that never completed one.

Decide what the evidence establishes

Store the checkpoint revision, template, enable_thinking setting, input prefix and newly generated output. Verify whether the final answer is complete and correctly separated for each tested mode.

A correct empty block can be accepted as expected formatting rather than treated as a failure. That does not establish that a provider forwards the control correctly on every request or that a model never performs internal computation when a visible trace is absent. The practical conclusion is about the documented prompt/output contract and correct handling of the final answer.

← All articles