In this article
Both standard desktop cards have 24GB VRAM; measure the actual workload before treating a newer GPU as a capacity upgrade.
For LLM workloads, the standard desktop RTX 3090 and RTX 4090 share an important capacity boundary: both have 24GB VRAM. Moving to the 4090 does not automatically fit a model twice as large. Compare compatibility, useful performance and complete host operation on the same task.
If a 3090 already sits idle, test it before purchasing a replacement. The experiment should identify which limitation a newer card would actually address.
Compare the official configurations
NVIDIA specifies Ampere and 24GB GDDR6X for the RTX 3090, and Ada Lovelace with 24GB GDDR6X for the desktop RTX 4090. These specifications identify hardware, not a serving benchmark.
| Question | RTX 3090 | RTX 4090 |
|---|---|---|
| Standard VRAM | 24GB | 24GB |
| Architecture | Ampere | Ada Lovelace |
| Workload comparison | Defined compatible configuration | Same model and task |
| Not established by the name | Complete service capacity | A fixed token rate |
Peak operations in different numerical formats and gaming results should not be converted into language-model speed through a universal multiplier.
Record the whole host
Preserve CPU, system RAM, drives, power and placement conditions. Comparing different hosts can be a useful operational experiment, but it evaluates two systems rather than an isolated GPU substitution.
For previously used hardware, include ordinary-temperature operation and a sustained agreed test. One successful short answer does not establish long-term stability. Avoid disabling protections or raising limits to reproduce someone else’s result.
Use one exact model artifact
Keep the model revision, weight format, prompt template and input/output limits fixed. Record concurrency. If one GPU requires another engine or format, make that a labelled comparison variant.
Test a short conversation, longer input and concurrent requests separately. Record first-token delay, completed-response time, errors and memory. A smaller numerical format may change quality as well as speed, so repeat the same correctness checks.
Evaluate operation before replacement
Measure whole-system energy and recovery after a normal restart. If readiness requires manual intervention each time, include that work in the schedule and operating estimate. Keep technical results separate from the cost of buying a card.
A useful conclusion identifies what works on the existing hardware and what a replacement improves under stated conditions. It does not infer paid utilisation from a faster benchmark.
Continue with RTX 4090 vs RTX 5090 for LLMs: Compare 24GB and 32GB and Choose a Local LLM for an RTX 3090 24GB.