ConfigIQ

LLM inference sizing, GPU comparison, and cost modeling for engineers and infrastructure teams.

A free community service, provided as-is without warranty. All results are best-effort estimates for planning, not guarantees of real-world performance.
What performance will I get?
Predict performance takes a model, GPU, and parallelism you already have and estimates TTFT, TPOT, and throughput.
What should I buy?
Recommend sizing starts from latency and throughput targets and searches for GPU count, tensor and pipeline parallelism, and replicas.
Will the model fit?
KV cache calculator estimates memory and KV headroom for a model and workload shape.

A complete comparison, including REST endpoints and MCP tools, is in User scenarios.

Recommend sizing

Find the optimal GPU configuration for a workload target using the AISimulators engine.


Open tool →
KV cache calculator

Calculate KV cache memory requirements for any model on supported GPU systems.


Open tool →
GPU explorer

Compare GPUs across memory, throughput, and architecture generation.


Open tool →
Predict performance

Estimate TTFT, TPOT, and throughput for your model and parallelism configuration.


Open tool →
Hybrid savings

Model cost savings between cloud, on-premise, and hybrid GPU deployment strategies.


Open tool →