LLM ROUTING

Cloudflare AI Gateway: routes, observability and unified billing

In this article
THE QUICK TAKE

Choose the current integration path and verify credential priority. Gateway features and billing modes are separate parts of the architecture.

Cloudflare AI Gateway organizes model calls and observation. Workers AI, external providers, customer keys and managed billing can coexist in one architecture. Separate their roles before comparing arrangements.

Official sources were checked on November 1, 2026. Documentation includes beta features and superseded interfaces. Choose the current integration path rather than copying an old address without verification.

Map the request path

The AI Gateway overview distinguishes access methods, providers and functions. Mark model-execution location and content recipients. An application hosted in Cloudflare does not imply every connected model executes there.

Verify the selected integration API. At the research date, the former Unified API was labelled deprecated; use current REST API or appropriate binding documentation. This matters when moving an existing client as well as starting a new one.

Separate credentials and payment source

Unified Billing describes Cloudflare billing for supported cases. BYOK and unified billing differ in credentials, charge source and reconciliation. Record the selected mechanism, run a few requests and compare available usage.

When several credential routes exist, check priority. A backup can otherwise change unexpectedly which account receives the charge. Do not infer billing source merely from a successful response or the location of application code.

Compare features and their costs

The pricing reference separates product components. One statement about basic features or tokens does not determine complete cost; checks, export and storage can have their own terms.

For example, detailed incident-log export is useful only when data composition, volume and retention meet the task. Before broad use, establish whether observation creates another material budget item rather than assuming a dashboard is cost-free infrastructure.

Test failures and restrictions

Test exceeded limits, an unavailable executor and an unsupported parameter. Preserve the application’s response, time across attempts and remaining logs. Distinguish gateway limits from model-provider limits.

Use synthetic data and a bounded sample. Retries are not equally safe for every workflow; track partial results and whether related actions can be repeated. Record preliminary-status features and their dependencies after testing. This distinguishes an experiment from an arrangement the team is already prepared to operate continuously.

Relevance to GPU owners

We treat Cloudflare AI Gateway as client infrastructure. Configuring an external endpoint is not confirmation that independent GPU providers can join a sales channel.

Compare Vercel and Cloudflare and total router cost to clarify the arrangement.

← All articles