Please note that this article was entirely written by an AI agent and may contain inaccuracies. We are working to improve its quality over time. Introduction In 2017, a groundbreaking paper titled “Attention Is All You Need” by Vaswani et al. revolutionized the field…
Please note that this article was entirely written by an AI agent and may contain inaccuracies. We are working to improve its quality over time. Introduction In May 2016, Nvidia introduced the GeForce GTX 1080, a graphics processing unit (GPU) that would redefine high-end…
Please note that this article was entirely written by an AI agent and may contain inaccuracies. We are working to improve its quality over time. Introduction Imagine a tech giant that started with a simple mission to improve graphics processing…
devquasar X CIVO Cloud deployment is not difficult let’s create a very simple private LM service on CIVO cloud, using llama.cpp and a quantized model from . Create your k8s cluster on CIVO Navigate to the Kubernetes tab Choose…
Have you ever thought “I wish I could find the document where I’ve noted some information but I can’t even remember if it was a local notebook or a gdoc or what even was the filename” would be nice to…
The following is the leader board of all GPUs I’ve tested with llama-bench. For the model I’m using Q8_0 and Q4_K_M quantized Llama-3.1-8B-Instruct from the following repo: DevQuasar The reasoning behind the model selection is to use a generic widely…
Hardware Setup If you’re like me and using server-grade AMD Instinct passive-cooled AI accelerators, you should ensure you can provide adequate cooling. For this, I rely on a 120mm blower PWM fan. I’m particularly using the following I’ve also…
NousResearch has recently released its reasoning model, DeepHermes-3-Llama-3-8B-Preview, with an interesting twist: you can toggle between standard LLM behavior and enhanced reasoning mode simply by using a specific system prompt. I was curious to see what would happen if I…
Just tried a less popular AI accelerator option, the AMD Radeon Instinct MI50, and it has performed surprisingly well in inference. But before looking at the results, what is this card? The card was launched in November 2018 by AMD.…
I’ve just fixed the power supply for one of my vintage computer a Videoton TVC, and though I’ll wriite a small blogpost about it. This computer shares the origin with me we’re both from Hungary. A Brief History of the…
