Go Back

Koboldcpp rocm

DevOps

About
Koboldcpp ROCm is a specialized, open-source fork of the KoboldCPP local large language model inference runner compiled with explicit AMD ROCm acceleration drivers, allowing users with AMD Radeon graphics hardware to achieve high-speed GPU tensor processing.