Inference on a $200 SBC
I’ve really wanted a server that I can use to host a quantized model for personal purposes, such as demoing a model, using it in a Hugging Face Space, etc. There are a huge variety of options to do this.…
I’ve really wanted a server that I can use to host a quantized model for personal purposes, such as demoing a model, using it in a Hugging Face Space, etc. There are a huge variety of options to do this.…