LLM Inference Performance Estimator
Pick a model to start.
Pick a model to see how it runs.
Out of date: these numbers are for the last split that ran.
Table
Memory per GPU GB
No model loaded yet.
Speed vs users
Table
Try instead
Estimates, not benchmarks.