Local AI & Regulated RAG Guides
GPU and VRAM sizing for local LLMs, document-parsing comparisons and compliance playbooks for running private AI in regulated industries.
Phase 1: Local AI & Hardware
vLLM vs Ollama for On-Prem LLM Serving: Concurrency, Memory and Security
vLLM vs Ollama for on-prem LLM serving: concurrency, memory use, model formats, hardware support, security defaults and a benchmark harness.
Qwen3-32B VRAM Calculator: FP16 vs Q8_0 vs Q4_K_M Memory Math and GPU Benchmarks
Qwen3-32B VRAM calculator: FP16, Q8_0 and Q4_K_M memory math, KV cache sizing, RTX 5090/4090 and Mac Studio estimates, plus Ollama and vLLM commands.