How have I not heard of this line of GPUs?? wth. lot of wattage. I’ve got a 7900xtx on my desktop and a modded 2080ti with 22gb vram and a 3060ti in my server (my old desktop hardware). I tried 27b dense at q4 or q5 a few weeks ago on my 2080ti and it was painfully slow and I was getting pretty mixed quality results.
How have I not heard of this line of GPUs?? wth. lot of wattage. I’ve got a 7900xtx on my desktop and a modded 2080ti with 22gb vram and a 3060ti in my server (my old desktop hardware). I tried 27b dense at q4 or q5 a few weeks ago on my 2080ti and it was painfully slow and I was getting pretty mixed quality results.
32gb of vram is hard to come by.