- First paper on how to train actual SOTA Decision Models ever: full playbook - architecture, datasets, training, evaluation, inference [R]
hey r/LLMDevs folks! my name is Alt, and I'm on the technical staff at Nace AI - Research Lab. . we just published a principled 50-page technical report detailing how our Drex decision models are...
66 points2 comments3 d ago
- I replaced vector-search RAG with Markdown + Knowledge Graphs using Claude CLI. The results surprised me.
I want to share something I've been experimenting with recently. Not claiming this is some revolutionary architecture or that I've solved RAG. I'm just curious if anyone else has tried something...
59 points19 comments3 d ago
- Can a 1-trillion-parameter model run on a 64 GB desktop? I built an open-source engine to find out, and it already beats llama.cpp on models bigger than RAM.
Kimi K2 has 1 trillion parameters but uses only about 32 billion per word. Banach keeps the right experts in RAM and streams the rest from NVMe, so the model doesn't have to fit in memory....
28 points31 comments4 d ago
- Open-source MCP server that lets LLM agents drive, walk and fly in 3D games in the background (demo reel)
I built this so agents could test game mods by actually playing the games, without needing the game in focus or taking over the PC. It's a stdio MCP server, so it works with Claude Code, Codex or...
26 points8 comments1 d ago
- Codex asks you to review each plugin hook before it runs. Postman's installer tries to approve its own
If you have Postman's desktop app and use Codex or Claude Code, check your config. Opening Postman added it to both agents. The person who reported it says they never opted in. We read the GitHub...
23 points4 comments5 d ago
- I gave my coding agents a message board as an experiment. It now runs my daily dev and project work
TL;DR: Inspired by the OpenAI incident, I gave my coding agents (Claude Code, Codex, Copilot) a message board to collaborate on. It worked better than expected. Building on that, I built a...
23 points18 comments6 d ago
- apple-llm 0.3: local STT, Apple’s on-device LLM, and TTS in one Node/Python package
I’m the author of apple-llm, an MIT-licensed Node and Python package for accessing the AI capabilities built into macOS. Version 0.3 adds text-to-speech and speech-to-text alongside the existing...
18 points3 comments3 d ago
- Elegant solution to keep personal per-project agent instructions and skills versioned without committing them to public repositories
The solution to this is actually just a bit more plain Git with usual commands that Git users are already used to. Suppose have notes, skills, and agent instructions that are part of your personal...
13 points3 comments4 d ago
- How to verify a LLM provider’s zero data retention? Contract, audit, and/or attestation? TEEs?
I’m reading enough security doomer posts here and on X that I’ve gotte nreal paranoid about sensitive client docs leaking through my model use. Am I crazy or is this what you’re all seeing too? If...
9 points22 comments4 d ago
- Does delegating to cheaper models actually save money? I tested it across three codebases.
Disclaimer: This is a small experiment, not a definitive benchmark. Most tasks were run twice, while everyday tasks were run once. I'd have liked to run more repetitions, but subscription usage...
9 points18 comments5 d ago