cheese_greater@lemmy.world to Ask Lemmy@lemmy.world · edit-210 hours agoWhat's a good local and free LLM model for Windows?message-squaremessage-square5fedilinkarrow-up116arrow-down112
arrow-up14arrow-down1message-squareWhat's a good local and free LLM model for Windows?cheese_greater@lemmy.world to Ask Lemmy@lemmy.world · edit-210 hours agomessage-square5fedilink
minus-squareoccultist8128@infosec.publinkfedilinkarrow-up2·4 hours agoWhat’s the minimum requirements for running it?
minus-squareToes♀@ani.sociallinkfedilinkarrow-up2·2 hours agoLots of RAM and a good cpu, benefits from cores. if you’re comfortable with it being on the slow side. There’s other versions of that model optimized for lower vram conditions too. But for better performance 8GB of vram minimum.
What’s the minimum requirements for running it?
Lots of RAM and a good cpu, benefits from cores. if you’re comfortable with it being on the slow side.
There’s other versions of that model optimized for lower vram conditions too.
But for better performance 8GB of vram minimum.