You must log in or register to comment.
The OS isn’t as important as the hardware being used.
AMD, Nvidia or Intel GPU?
How much RAM & vram are you working with?
What’s your CPU?
Generally speaking I would suggest koboldcpp with gemma3.
Use the app Jan, it’s a good one and has a place where it recommends models for your hardware
Ew
