Ovi's Tech Blog

I love technology!

HOME
CATEGORIES
TAGS
ARCHIVES
ABOUT

Home Tags quantization

Tag

quantization 1

Getting Started with running LLM models locally Nov 16, 2025

Recently Updated

My personal LLM toolchain: switch between models and harnesses, control them from your phone
Recipe for running Qwen3.8-Flash-Next in NVFP4 on 2x RTX Pro 6000
Reviving a 30-year-old video game magazine with LLMs
Upgrading my house electrical system for AI workloads
Forecasting with Foundation Models: Capacity Planning and Incident Detection

Trending Tags

llm vllm local-inference agents coding-agents gpt-oss hardware qwen capacity-planning claude

© 2026 Ovidiu Dan. Some rights reserved.

Using the Chirpy theme for Jekyll.

Trending Tags

llm vllm local-inference agents coding-agents gpt-oss hardware qwen capacity-planning claude

New content available