MODELS AND MODALITIES

Open d1: decision probabilities and application policy

Event source: Liquid publishes Open d1 decision-model weights ↗

In this analysis
THE RETROSPECTIVE TAKE

Version the action rule separately from raw model output, because changing a threshold changes policy even with identical weights.

Open d1 exposes a decision interface, but the application’s action threshold remains a separate policy choice with consequences that model publication cannot determine.

The published interface

The open-weight announcement presents bounded decision models rather than ordinary text generation. That makes it possible to separate a returned decision quantity from the action an application takes. Publishing the model does not establish which kinds of error matter most to a particular user or workflow.

Earlier stages of the idea

The encoder release supplies earlier architectural context, while the hosted d1 announcement establishes the preceding decision interface. The weight publication changes access to an artifact. It does not create a universal policy that converts all decision outputs into appropriate actions under every distribution of inputs.

A model result and a deployment rule therefore need distinct records. Otherwise a changed threshold can look like changed model quality, even when the weights and raw outputs stayed fixed. The application has changed its behaviour, but not necessarily its predictor.

A review-queue example

Imagine a catalogue where suspicious entries are sent for human review. A permissive rule can reduce review workload while allowing more questionable entries through. A conservative rule can catch more such entries while increasing unnecessary reviews. Neither tradeoff can be chosen solely by reading the model’s release announcement.

Keep the raw output, selected action and eventual reviewed outcome together. A later evaluation can then ask whether the predictor changed, whether the action rule changed or whether the incoming cases changed. Combining those causes in one acceptance percentage would make the result difficult to interpret.

Confidence is not policy

A numerical output can appear authoritative because it is precise. Its practical meaning still depends on the task, input distribution and evidence used to interpret it. The announcement does not by itself establish calibration for a new catalogue or guarantee that a selected cutoff has a particular error rate.

The appropriate acceptance fixture includes borderline cases and the costs of the available actions. Those costs are application judgments. They should remain visible instead of being disguised as inevitable consequences of the model’s architecture or the number displayed by a client interface.

The retrospective contribution

The release makes a decision-oriented artifact available for inspection and execution. Its useful consequence is a cleaner separation between prediction and downstream action, provided the operator preserves that separation in the surrounding system.

The conclusion is not a recommended cutoff. It is an evidence structure: identify the model output, version the action rule and retain outcomes that can test their combination. That makes later policy changes explainable without attributing every change to the model.

Further analysis: Reproducible inference stacks: preserving a GPU pilot’s result; GPU hosting for multimodal models: count more than text.

← All retrospectives