Tag: gguf

Testing the 9x Smaller Local LLM Claim on a GPU-less VPS

I ran Prism's ternary-quantized Bonsai 2 27B, a 27B model squeezed under 6GB, on a GPU-less VPS to test its near-lossless claim. Here's what happened.