Show HN: Train LoRA directly on the GGUF you have, then merge the adapter
By JoakimPalm-Zen · 2026-10-22 · 1 points · 0 comments
https://www.reddit.com/r/LocalLLaMA/comments/1x5j48s/train_lora_directly_on_quantized_ggufs_no_pytorch/
Use the same GGUF you serve, merge the adapter back into it and then use the same engine to run the model, all in all a "LLM Toolbox"
Open the full discussion on BetterNews