TECH RADAR / SERVING ENGINES
TensorRT-LLM
NVIDIA GPU inference runtime and optimizations.
What it covers
GPU-specific execution, quantization, and cache configuration.
What we would check
Check the exact model, hardware, precision, and runtime support before comparing a configuration.
Go to the source
A curated ecosystem entry. The evaluation guidance is our interpretation, not a report of a completed test or a performance ranking.