i went through every uncensored and abliterated models on hugging face and picked the best ones for each vram tier from 8 to 24gb.
welcome to the danger zone ⚠️
━━━━━━━━━━━━━━━━━━━━
8gb · rtx 3060 ti, 3070, 4060, 5060, 4060 ti 8gb, 5060 ti 8gb · amd rx 6600, 6650 xt, 7600, 9060 xt 8gb · the base runs 42.8 tok/s on a 3060 ti 8gb out to a 96k window
- bonsai 2 27b heretic, 1-bit, 5.95gb, refusals 95 to 0 out of 100, 147k downloads this month
http://huggingface.co/OS-Software/Ternary-Bonsai-2-27B-Uncensored-Heretic-GGUF…