Ovi's Tech Blog

I love technology!

HOME
CATEGORIES
TAGS
ARCHIVES
ABOUT

Home Tags inference

Tag

inference 1

Getting Started with running LLM models locally Nov 16, 2025

Recently Updated

Forecasting with Foundation Models: Capacity Planning and Incident Detection
Running DeepSeek-V4-Flash at 700 tokens/s on 2x RTX Pro 6000
Coding locally with Pi Coding agent and open weights models (April 2026 edition)
What Happened When I Gave Luna Access to My Email
Luna: An AI Assistant That Works While I Sleep

Trending Tags

llm vllm agents gpt-oss local-inference capacity-planning coding-agents deepseek email fine-tuning

© 2026 Ovidiu Dan. Some rights reserved.

Using the Chirpy theme for Jekyll.

Trending Tags

llm vllm agents gpt-oss local-inference capacity-planning coding-agents deepseek email fine-tuning

New content available