Last summer I decided to build an AI Workstation for myself with dual goals:1) Enable me to play with not just models but also learn about the various hardware configurations that are usually hidden from you if you’re using the…
In conventional application architecture, client-side components interact with backend services to deliver functionality and value to end-users. Application developers must possess a comprehensive understanding of the application programming interface (API) to facilitate this interaction. Moreover, the application must be adaptable…
Here’s my simple iOS app that enables you to interface with any OpenAI API compatible LLM from your iPhone or iPad. You can run your local LLM with e.g. LMStudio and communicate with it from your phone. Release of the…
Just point to the question/problem/document with the mouse anywhere on your screen and get the help of the LLM of your choice. The screenshot above illustrates how to use aiHub with a local LLM to help to summarize an article…
Google Gemini has announced 2 days ago with a jaw dropping multimodal demo. Today its seems it’s not as cool as it looked at first.Here’s the article about the details of the demo
Your IDE has AI integration? Great. Oh, your chat app has another LLM that helps with your tasks? Okay. Are you facing issues in your terminal window? You can copy-paste the text to a web-based LLM chatbot, well… yes it’s…
I’ve experimented with the Orca2 model in the last few weeks, and the generation quality for the parameter size has truly impressed me. I believe that the Orca2 7B and 13B quantized models offer the optimal combination of quality and…
LM Studio provides a remarkable tool that empowers users to efficiently run quantized Large Language Models (LLMs) locally. I have identified three standout features: Apple Metal demonstrated a remarkable 2.8x improvement in tokens per second using the LLaMa CPP-based approach…
The ongoing AI revolution has significantly transformed the landscape of human-computer interaction, wherein Large Language Models (LLMs) play a pivotal role in addressing complex challenges, thereby allowing individuals to channel their focus towards creative endeavors. While a multitude of AI-integrated…
