koboldcpp
KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models, featuring a bundled KoboldAI Lite frontend.
About
KoboldCpp is a self-contained AI text generation platform built on llama.cpp that runs GGML and GGUF models locally. It targets AI enthusiasts, developers, and researchers who want to deploy text and multimodal AI generation without relying on cloud services.
