local-llm - Abrarqasim Blogs

LLM Quantization Flipped: A 4-Bit Model Beat Its 16-Bit Source

A 4-bit model just beat the 16-bit checkpoint it was quantized from. I break down quantization-aware healing, the numbers, and what it changes for local…

Rayyan | August 31, 2026 | 8 min

AI

Running Qwen 3.8 27B Locally: The Reasoning Effort Trap

Qwen 3.8 27B defaults to maximum reasoning effort on every prompt, even simple ones. Here's how to run it locally, spot the setting, and control…

Rayyan | August 19, 2026 | 7 min

AI

Local LLM Text-to-SQL: Where It Helped and Where It Lied

I pointed a local 7B model at my Postgres database to write SQL from plain English. Here's where text-to-sql LLMs held up, where they lied,…

Rayyan | June 21, 2026 | 8 min

AI

Local LLMs in 2026: What I Actually Run, and What I Don’t

I spent a month running local LLMs on my own GPU instead of an API. Here is where self-hosted models earned their place, and where…

Rayyan | May 23, 2026 | 8 min