50 newest GPUs & AI hardware

The most recently released devices for running models locally, newest first. VRAM decides which models fit; memory bandwidth decides how fast they run.

NVIDIA RTX Spark N1X (128 GB)New

128 GB · 273 GB/s

~32 tok/s on Llama 3 8B

Released Oct 2026

Radeon AI PRO 9600DNew

32 GB · 576 GB/s

~67 tok/s on Llama 3 8B

Released Dec 2025

Radeon AI PRO R9700SNew

32 GB · 645 GB/s

~75 tok/s on Llama 3 8B

Released Dec 2025

RTX PRO 5000 72 GB Blackwell

72 GB · 1340 GB/s

~157 tok/s on Llama 3 8B

Released Oct 2025

NVIDIA DGX Spark (GB10)New

128 GB · 273 GB/s

~32 tok/s on Llama 3 8B

Released Oct 2025

Radeon PRO W7900DNew

48 GB · 864 GB/s

~101 tok/s on Llama 3 8B

Released Sep 2025

Radeon RX 7700

16 GB · 622 GB/s

~73 tok/s on Llama 3 8B

Released Sep 2025

Arc Pro B50

16 GB · 224 GB/s

~26 tok/s on Llama 3 8B

Released Sep 2025

Arc Pro B60

24 GB · 456 GB/s

~53 tok/s on Llama 3 8B

Released Sep 2025

NVIDIA Jetson AGX Thor (T5000)New

128 GB · 273 GB/s

~32 tok/s on Llama 3 8B

Released Aug 2025

NVIDIA Jetson Thor (T4000)New

64 GB · 273 GB/s

~32 tok/s on Llama 3 8B

Released Aug 2025

GeForce RTX 5090 D V2

24 GB · 1340 GB/s

~157 tok/s on Llama 3 8B

Released Aug 2025

RTX PRO 2000 Blackwell

16 GB · 288 GB/s

~34 tok/s on Llama 3 8B

Released Aug 2025

RTX PRO 4000 Blackwell SFF

24 GB · 432 GB/s

~51 tok/s on Llama 3 8B

Released Aug 2025

Radeon RX 7400

8 GB · 288 GB/s

~34 tok/s on Llama 3 8B

Released Aug 2025

Radeon RX 9060

8 GB · 322 GB/s

~38 tok/s on Llama 3 8B

Released Aug 2025

Radeon AI PRO R9700New

32 GB · 645 GB/s

~75 tok/s on Llama 3 8B

Released Jul 2025

NVIDIA RTX 5050

8 GB · 320 GB/s

~37 tok/s on Llama 3 8B

Released Jul 2025

GeForce RTX 5050 Mobile

8 GB · 384 GB/s

~45 tok/s on Llama 3 8B

Released Jun 2025

Radeon RX 9060 XT 16 GB

16 GB · 322 GB/s

~38 tok/s on Llama 3 8B

Released Jun 2025

GeForce RTX 5060 Mobile

8 GB · 384 GB/s

~45 tok/s on Llama 3 8B

Released May 2025

NVIDIA RTX 5060

8 GB · 448 GB/s

~52 tok/s on Llama 3 8B

Released May 2025

Radeon RX 9070 GRE

12 GB · 432 GB/s

~51 tok/s on Llama 3 8B

Released May 2025

NVIDIA RTX 5060 Ti

16 GB · 448 GB/s

~52 tok/s on Llama 3 8B

Released Apr 2025

Framework Desktop

16 GB · 120 GB/s

~14 tok/s on Llama 3 8B

Released Apr 2025

GeForce RTX 5080 Mobile

16 GB · 896 GB/s

~105 tok/s on Llama 3 8B

Released Apr 2025

GeForce RTX 5070 Mobile

8 GB · 384 GB/s

~45 tok/s on Llama 3 8B

Released Apr 2025

GeForce RTX 5090 Mobile

24 GB · 896 GB/s

~105 tok/s on Llama 3 8B

Released Mar 2025

RTX 6000D

84 GB · 1570 GB/s

~184 tok/s on Llama 3 8B

Released Mar 2025

RTX PRO 4000 Blackwell

24 GB · 672 GB/s

~79 tok/s on Llama 3 8B

Released Mar 2025

RTX PRO 4500 Blackwell

32 GB · 896 GB/s

~105 tok/s on Llama 3 8B

Released Mar 2025

RTX PRO 6000 Blackwell Max-Q

96 GB · 1790 GB/s

~210 tok/s on Llama 3 8B

Released Mar 2025

RTX PRO 6000 Blackwell Server

96 GB · 1790 GB/s

~210 tok/s on Llama 3 8B

Released Mar 2025

RTX PRO 6000 Blackwell

96 GB · 1790 GB/s

~210 tok/s on Llama 3 8B

Released Mar 2025

RTX PRO 6000D Blackwell Max-Q

96 GB · 1790 GB/s

~210 tok/s on Llama 3 8B

Released Mar 2025

Mac Studio M4 Ultra

192 GB · 819 GB/s

~96 tok/s on Llama 3 8B

Released Mar 2025

Apple MacBook Air M4

16 GB · 120 GB/s

~14 tok/s on Llama 3 8B

Released Mar 2025

AMD Radeon RX 9070 XT

16 GB · 640 GB/s

~75 tok/s on Llama 3 8B

Released Mar 2025

AMD Radeon RX 9070

16 GB · 512 GB/s

~60 tok/s on Llama 3 8B

Released Mar 2025

NVIDIA RTX 5070

12 GB · 672 GB/s

~79 tok/s on Llama 3 8B

Released Mar 2025

GeForce RTX 5070 Ti Mobile

12 GB · 672 GB/s

~79 tok/s on Llama 3 8B

Released Mar 2025

NVIDIA RTX 5070 Ti

16 GB · 896 GB/s

~105 tok/s on Llama 3 8B

Released Feb 2025

Radeon RX 7650 GRE

8 GB · 288 GB/s

~34 tok/s on Llama 3 8B

Released Feb 2025

NVIDIA RTX 5080

16 GB · 960 GB/s

~112 tok/s on Llama 3 8B

Released Jan 2025

GeForce RTX 5090 D

32 GB · 1790 GB/s

~210 tok/s on Llama 3 8B

Released Jan 2025

NVIDIA RTX 5090

32 GB · 1792 GB/s

~210 tok/s on Llama 3 8B

Released Jan 2025

Intel Arc B570

10 GB · 360 GB/s

~42 tok/s on Llama 3 8B

Released Jan 2025

Jetson Orin Nano SuperNew

8 GB · 102 GB/s

~12 tok/s on Llama 3 8B

Released Dec 2024

Intel Arc B580

12 GB · 456 GB/s

~53 tok/s on Llama 3 8B

Released Dec 2024

Apple Mac Mini M4 Pro

24 GB · 273 GB/s

~32 tok/s on Llama 3 8B

Released Nov 2024