Ovi's Tech Blog

I love technology!

HOME
CATEGORIES
TAGS
ARCHIVES
ABOUT

Home Tags inference

Tag

inference 1

Getting Started with running LLM models locally Nov 16, 2025

Recently Updated

Luna: An AI Assistant That Works While I Sleep
Fixing RTX Pro 6000 Blackwell shutdowns with custom fan control
Running MiniMax-M2.1 Locally with Claude Code on Dual RTX Pro 6000
The age of hyper-personalized software
Guide on installing and running the best models on a dual RTX Pro 6000 rig with vLLM

Trending Tags

llm vllm gpt-oss agents fine-tuning glm-4.6 gpt-oss-120b hardware inference librechat

© 2026 Ovidiu Dan. Some rights reserved.

Using the Chirpy theme for Jekyll.

Trending Tags

llm vllm gpt-oss agents fine-tuning glm-4.6 gpt-oss-120b hardware inference librechat

A new version of content is available.