Can the MacBook Pro 16" M4 Max run Nemotron 3.5 Super VL?

Yes. Nemotron 3.5 Super VL fits the MacBook Pro 16" M4 Max's 48 GB at Q4_K_M (about 39.8 GB needed), running at an estimated 8.2 tok/s.

Memory
48 GB
Needs at Q4
39.8 GB
Headroom
8.2 GB
Speed (Q4_K_M)
~8.2 tok/s

Every quantization

Nemotron 3.5 Super VL (65.8B) on 48 GB

QuantWeightsNeedsFitEst. speed
Q4_K_M38 GB39.8 GBFits~8.2 tok/s
Q5_K_M47 GB48.8 GBToo big -
Q8_070 GB71.8 GBToo big -
FP16132 GB133.8 GBToo big -

Estimates. Needs = weights + 1.8 GB for KV cache and runtime at modest context. Speed is single-stream decode scaled from the MacBook Pro 16" M4 Max's 546 GB/s bandwidth (Estimated from memory bandwidth (llama.cpp decode)). Long contexts need more memory and run slower.

Compare

Same model, other hardware - and other models on this card

Nemotron 3.5 Super VL on other hardware

Also runs on the MacBook Pro 16" M4 Max

Frequently asked

Quick answers

Can the Apple MacBook Pro 16" M4 Max run Nemotron 3.5 Super VL?

Yes. Nemotron 3.5 Super VL fits the MacBook Pro 16" M4 Max's 48 GB at Q4_K_M (about 39.8 GB needed), running at an estimated 8.2 tok/s.

How much VRAM does Nemotron 3.5 Super VL need?

About 38 GB of weights at Q4_K_M, 70 GB at Q8_0 and 132 GB at FP16. Add roughly 1.8 GB for the KV cache and runtime at modest context lengths.

How fast is Nemotron 3.5 Super VL on the MacBook Pro 16" M4 Max?

Roughly 8.2 tokens per second at Q4_K_M (single user, llama.cpp-style decode). This is an estimate from the MacBook Pro 16" M4 Max's 546 GB/s memory bandwidth.