NVIDIA L40S
NVIDIA L40S
The NVIDIA L40S is a datacenter-focused GPU based on Ada Lovelace architecture with 48 GB of ECC GDDR6 memory at 864 GB/s bandwidth. Designed for AI inference and rendering in cloud and enterprise environments, it's essentially a datacenter version of the RTX 6000 Ada with higher power limits and improved multi-instance GPU (MIG) support.
Quick verdict
The L40S is for enterprise AI deployment, not consumer use. 48 GB VRAM runs any model up to 120B parameters. The ~$8,500+ price tag puts it out of reach for individuals, but for businesses deploying private AI infrastructure, it's competitive with cloud GPU pricing.
Spec breakdown
- VRAM: 48 GB GDDR6 ECC
- Memory bandwidth: 864 GB/s
- TDP: 350 W
- Architecture: Ada Lovelace AD102
- CUDA cores: 18,176
- Tensor cores: 568 (4th gen)
- MIG: Up to 7 instances
Best models that fit
- Q4_K_M: Llama 3.3 70B - plenty of room
- Q4_K_M: DeepSeek R1 120B - fits entirely in VRAM
Honest alternatives
- RTX 6000 Ada (~$5,800): Same VRAM, consumer-friendly
- Mac Studio M4 Ultra 192GB (~$5,300): More memory, different architecture
Frequently asked
Quick answers to common questions
How much VRAM does the NVIDIA L40S have?
The NVIDIA L40S has 48 GB of VRAM with 864 GB/s memory bandwidth. MSRP was $10,200.
What local AI models can run on the NVIDIA L40S?
The NVIDIA L40S with 48 GB VRAM can run many models depending on quantization. Models up to ~73B params may fit at Q4_K_M. Use our VRAM calculator to check specific models.
Is the NVIDIA L40S good for local AI inference?
NVIDIA L40S is best for llm-inference, professional, datacenter. With ample VRAM it handles most open models well.
Where can I buy the NVIDIA L40S?
Check our buy links above for the best current prices on Amazon, Newegg, and B&H. Prices vary by retailer and availability.
How does the NVIDIA L40S compare to other GPUs?
NVIDIA L40S has 48 GB VRAM and 864 GB/s bandwidth. This puts it in the high-end category, suitable for most open models. Browse our hardware directory for side-by-side comparisons.
Is the NVIDIA L40S worth buying right now?
The current price is $8500 vs the MSRP of $10,200. The price has dropped below MSRP, making it a good time to buy.
What power supply do I need for the NVIDIA L40S?
The NVIDIA L40S has a TDP of 350W. This requires a high-wattage PSU (850W+ recommended). Always check the manufacturer's recommendations for your specific build.
Nearby options
Similar hardware and models that fit
Similar hardware
Comments coming soon
Configure NEXT_PUBLIC_GISCUS_REPO_ID and NEXT_PUBLIC_GISCUS_CATEGORY_ID at giscus.app to enable.