Verified record · from the answer index
serving-llms-on-epyc
skilltested · static-verifiedscore 43/100signed passport ✓650 uses
Serves an LLM on a supported AMD EPYC server CPU using vLLM with zentorch, in Docker, Podman, or conda. Use for "vLLM on CPU", "zentorch serving", or an EPYC CPU endpoint, including on a host that also has AMD Instinct GPUs. Detects the EPY
Declared tools (1)
serving-llms-on-epyc
skill:amd/skills/serving-llms-on-epyc · published by amd · source repository