Local

LM Studio provides a remarkable tool that empowers users to efficiently run quantized Large Language Models (LLMs) locally. I have identified three standout features: Apple Metal demonstrated a remarkable 2.8x improvement in tokens per second using the LLaMa CPP-based approach…

Scattered AI tooling

The ongoing AI revolution has significantly transformed the landscape of human-computer interaction, wherein Large Language Models (LLMs) play a pivotal role in addressing complex challenges, thereby allowing individuals to channel their focus towards creative endeavors. While a multitude of AI-integrated…