You must log in or register to comment.
The OS isn’t as important as the hardware being used.
AMD, Nvidia or Intel GPU?
How much RAM & vram are you working with?
What’s your CPU?
Generally speaking I would suggest koboldcpp with gemma3.
What’s the minimum requirements for running it?
Lots of RAM and a good cpu, benefits from cores. if you’re comfortable with it being on the slow side.
There’s other versions of that model optimized for lower vram conditions too.
But for better performance 8GB of vram minimum.
Use the app Jan, it’s a good one and has a place where it recommends models for your hardware
Ew
