Just tried a less popular AI accelerator option, the AMD Radeon Instinct MI50, and it has performed surprisingly well in inference. But before looking at the results, what is this card? The card was launched in November 2018 by AMD.…
I’ve just fixed the power supply for one of my vintage computer a Videoton TVC, and though I’ll wriite a small blogpost about it. This computer shares the origin with me we’re both from Hungary. A Brief History of the…
Story The Google Search Appliance (GSA) emerged as part of Google’s early exploration into enterprise solutions. Launched in 2002, the GSA allowed organizations to deploy Google’s web search power internally. Originally positioned as a hardware solution to simplify corporate data…
This is just a quick post of a System prompt created by me for task solving.GSTS stands for Goal Strategy Tactic Steps Key characteristics Analytical and Articulate: Emphasizes the assistant’s ability to thoughtfully express and reframe ideas, which would enhance…
I came across a few unusual prompts and wanted to dig deeper, understand the motivations behind them, and test their effectiveness. Some of these techniques are not new, and some might not work, but let’s explore how humans (and possibly…
I wanted to experiment with combining image generation and vision models to see how images evolve when each description is used as the next prompt for the generator. My goal was to observe whether this feedback loop causes images to…
Sample code to generate the gif
Elmo chat is Lepton AI’s little fun chrome extension that lines in your chrome browser and offering summarization question answering and even TTS (Text To Speech) do chat with the webpage you’re browsing. Slowly but surely changing the way we’re…
I’ve rerun the Speculative Decoding experiment with some larger models where I’ve paired a Llama 3 70B primary model with the 8B draft model, to see if a larger model Llama 3 70B can benefit more from a draft model…
And there I’ve crunched the numbers on GPU. The configuration is a 3GPU system 1x RTX4080 + 2x RTX3090. Baseline has been set by the following llama.cpp generation command (same generation config and prompts has been used in the Speculative…
