- Kimi 3.1 Pro
Has someone experience with it?
59 points5 comments4 d ago
- What are currently the go to 4b and 9b models?
As the title states I am currently looking for the best 4b and 9b models to run locally. What are your experiences and what would you recommend?
43 points38 comments2 d ago
- What can I realistically do with local AI on a Mac mini M5 Pro (48GB)?
I just got a Mac mini with an M5 Pro (base CPU config) and 48GB of unified memory. I want to run as much AI locally as makes sense, but it's hard to separate what actually works day to day from...
39 points30 comments16 h ago
- I built an open source meeting notetaker that summarises with local Ollama model (Google Meet and Teams)
I wanted Otter or Fireflies style meeting notes with a bit more control/privacy, so I built OpenMinutes. A bot joins your Google Meet or Microsoft Teams call, records it, and writes a transcript...
36 points4 comments5 d ago
- Benchmarking Qwen3.8-27B across 6 inference engines: GGUF vs NInfer, 64K–256K context, speed AND quality
I've been working on a comprehensive Qwen3.8-27B inference benchmark comparing six engines, including TensorSharp, Ollama, llama.cpp, vLLM, SGLang, and NInfer. Most LLM benchmarks focus on...
35 points13 comments3 d ago
- SurfSense 2.3.0: an open-source NotebookLM alternative that runs on your Ollama models
I'm one of the maintainers, so this is self-promotion. I posted here a couple of weeks ago, and a lot has changed since, so here's an update. SurfSense is an open-source (Apache-2.0) desktop app...
30 points5 comments6 d ago
- Ollama runs the brain of a stick figure that lives on my Mac desktop
I made a stick figure that lives on my Mac desktop, and a local Ollama model decides what it does. Repo: https://github.com/surenjanath/stickman How it uses Ollama: Every 4 seconds it calls...
28 points8 comments5 d ago
- Trying "Weight-Space Programming" on a local 35B GGUF to fix agent loops
After reading MIT CSAIL’s Sparks of Weight-Space Programming (especially Experiment 8, where an LLM fixes Qwen3.5’s reasoning loops by editing 64 MLP columns directly), I wanted to see if an agent...
22 points1 comment6 d ago
- I gave my desktop pets a tiny local brain (gemma3:1b in Ollama) and now they ignore me on purpose
I made a little Mac app with nine desktop pets: three cats, a fox, a raccoon, two dogs, a rabbit and a squirrel. They walk on top of your windows, nap, steal stuff and ignore you when you call...
21 points11 comments1 d ago
- What is the current best coding model for 12gb vram?
Hi, I have an Intel Arc B580 and as you know it has 12gb vram, i was wondering if any of you could advise me on what is the best coding model that fits within that size. I know qwen 3.8 27b and...
15 points35 comments15 h ago