>>960586
Thanks I'll give it a try. I was just filtering by downloads and was trying this one: https://huggingface.co/bartowski/Llama-3.2-3B-Instruct-uncensored-GGUF
I think 8B will be the max for my card. Not sure how holding the rest of the model in system memory etc works yet