Verified record · from the answer index

model-free-nim-pb6

Model-Free NIM 2.0 is a NIM microservice container designed to support a broad range of LLMs. It includes a production-ready inference runtime with optimized inference engines from NVIDIA and the community such as vLLM. NVIDIA NIM: runs as

model:ngc:nim/nvidia/model-free-nim-pb6