AI rig upgrades
Since I have the 2nd 3090 I’m working on niche Fine-tuned model. As I’m generating the data or do training the machine is running all the time. I’m sharing 2 set of monitors between that and other computers, and it’s…
Category Edge
AI workstation [GPU it#4]
Last summer I decided to build an AI Workstation for myself with dual goals:1) Enable me to play with not just models but also learn about the various hardware configurations that are usually hidden from you if you’re using the…
Orca 2
I’ve experimented with the Orca2 model in the last few weeks, and the generation quality for the parameter size has truly impressed me. I believe that the Orca2 7B and 13B quantized models offer the optimal combination of quality and…
Local
LM Studio provides a remarkable tool that empowers users to efficiently run quantized Large Language Models (LLMs) locally. I have identified three standout features: Apple Metal demonstrated a remarkable 2.8x improvement in tokens per second using the LLaMa CPP-based approach…