devquasar X CIVO Cloud deployment is not difficult let’s create a very simple private LM service on CIVO cloud, using llama.cpp and a quantized model from . Create your k8s cluster on CIVO Navigate to the Kubernetes tab Choose…
Have you ever thought “I wish I could find the document where I’ve noted some information but I can’t even remember if it was a local notebook or a gdoc or what even was the filename” would be nice to…
The following is the leader board of all GPUs I’ve tested with llama-bench. For the model I’m using Q8_0 and Q4_K_M quantized Llama-3.1-8B-Instruct from the following repo: DevQuasar The reasoning behind the model selection is to use a generic widely…
Hardware Setup If you’re like me and using server-grade AMD Instinct passive-cooled AI accelerators, you should ensure you can provide adequate cooling. For this, I rely on a 120mm blower PWM fan. I’m particularly using the following I’ve also…
NousResearch has recently released its reasoning model, DeepHermes-3-Llama-3-8B-Preview, with an interesting twist: you can toggle between standard LLM behavior and enhanced reasoning mode simply by using a specific system prompt. I was curious to see what would happen if I…
Just tried a less popular AI accelerator option, the AMD Radeon Instinct MI50, and it has performed surprisingly well in inference. But before looking at the results, what is this card? The card was launched in November 2018 by AMD.…
I’ve just fixed the power supply for one of my vintage computer a Videoton TVC, and though I’ll wriite a small blogpost about it. This computer shares the origin with me we’re both from Hungary. A Brief History of the…
Story The Google Search Appliance (GSA) emerged as part of Google’s early exploration into enterprise solutions. Launched in 2002, the GSA allowed organizations to deploy Google’s web search power internally. Originally positioned as a hardware solution to simplify corporate data…
This is just a quick post of a System prompt created by me for task solving.GSTS stands for Goal Strategy Tactic Steps Key characteristics Analytical and Articulate: Emphasizes the assistant’s ability to thoughtfully express and reframe ideas, which would enhance…
I came across a few unusual prompts and wanted to dig deeper, understand the motivations behind them, and test their effectiveness. Some of these techniques are not new, and some might not work, but let’s explore how humans (and possibly…
