local-llm - Abrarqasim Blogs

Testing the 9x Smaller Local LLM Claim on a GPU-less VPS

Testing the 9x Smaller Local LLM Claim on a GPU-less VPS

I ran Prism's ternary-quantized Bonsai 2 27B, a 27B model squeezed under 6GB, on a GPU-less VPS to test its near-lossless claim. Here's what happened.

Rayyan | September 29, 2026 | 8 min

LLM Quantization Flipped: A 4-Bit Model Beat Its 16-Bit Source

LLM Quantization Flipped: A 4-Bit Model Beat Its 16-Bit Source

A 4-bit model just beat the 16-bit checkpoint it was quantized from. I break down quantization-aware healing, the numbers, and what it changes for local…

Rayyan | August 31, 2026 | 8 min

Running Qwen 3.8 27B Locally: The Reasoning Effort Trap

Running Qwen 3.8 27B Locally: The Reasoning Effort Trap

Qwen 3.8 27B defaults to maximum reasoning effort on every prompt, even simple ones. Here's how to run it locally, spot the setting, and control…

Rayyan | August 19, 2026 | 7 min

Local LLM Text-to-SQL: Where It Helped and Where It Lied

Local LLM Text-to-SQL: Where It Helped and Where It Lied

I pointed a local 7B model at my Postgres database to write SQL from plain English. Here's where text-to-sql LLMs held up, where they lied,…

Rayyan | June 21, 2026 | 8 min

Local LLMs in 2026: What I Actually Run, and What I Don’t

Local LLMs in 2026: What I Actually Run, and What I Don’t

I spent a month running local LLMs on my own GPU instead of an API. Here is where self-hosted models earned their place, and where…

Rayyan | May 23, 2026 | 8 min