cheese_greater@lemmy.world to Ask Lemmy@lemmy.world · edit-210 hours agoWhat's a good local and free LLM model for Windows?message-squaremessage-square5fedilinkarrow-up116arrow-down112
arrow-up14arrow-down1message-squareWhat's a good local and free LLM model for Windows?cheese_greater@lemmy.world to Ask Lemmy@lemmy.world · edit-210 hours agomessage-square5fedilink
minus-squareToes♀@ani.sociallinkfedilinkarrow-up2·2 hours agoLots of RAM and a good cpu, benefits from cores. if you’re comfortable with it being on the slow side. There’s other versions of that model optimized for lower vram conditions too. But for better performance 8GB of vram minimum.
Lots of RAM and a good cpu, benefits from cores. if you’re comfortable with it being on the slow side.
There’s other versions of that model optimized for lower vram conditions too.
But for better performance 8GB of vram minimum.