Skip to content
KoboldCpp
GitHub

Help and next steps

Many problems show an error message in the console window. Keep it open and read it.

Windows or your antivirus blocks the file. For files from the official releases this is a false alarm: the file is not signed. Click More info, then Run anyway, or allow the file in your antivirus. More

The window closes straight away. Start KoboldCpp from a Command Prompt (Windows) or a terminal, so the error stays on screen. On an older PC, try the oldpc file. More

"Out of memory", or a crash while loading. Pick a smaller model or the LowSpec template, and close other programs that use the graphics card. More

Replies are very slow. Check that Backend: on Quick Launch shows Use CUDA (NVIDIA) or Use Vulkan (AMD, Intel), not Use CPU. If Use CUDA is missing on an NVIDIA PC, you have the nocuda file; download koboldcpp.exe instead. More

The model doesn't load. Use one .gguf file, and download it again if the download was cut short. Newer model types need the latest KoboldCpp. More

Nothing happens on macOS. Run it from Terminal as shown in Start KoboldCpp, and allow it in System Settings → Privacy & Security. More

Ask on the KoboldAI Discord or in GitHub Discussions. Found a bug? Report it on GitHub. Copy the error from the console window into your message.

Everything else is in the wiki.