- Maybe we'll get cheap RAM for Christmas after all!
2,509 points521 comments6 d ago
- Qwen3.8-27B has become unuseable recently
When it came out, I downloaded a Q4 quant of qwen3.8-27b and ran it using llama.cpp on my RTX 4090 and it was incredible. It could handle practically anything I threw at it, the most complex tasks...
1,587 points393 comments7 d ago
- Z.ai chief scientist Jie Tang just revealed the training pipeline behind the upcoming GLM-5.5 (32B, 122B, and 256B)
Smaller GLM models are coming! GLM 5.5 will have a 32B model!
1,250 points199 comments6 d ago
- We are cooked. My QFN 3.8 NVFP4 just drew a dog freehand in MS Paint (using new Open WebUI 0.13.0 and Open Terminal 0.17.2)
Forget stupid pelican on a bike SVG bullshit. Forget cheating by drawing using Python code. I just loaded up QFN 3.8 in the new Open WebUI 0.13.0 and it just said “hold my beer” and started...
1,204 points182 comments5 d ago
- "Does censorship exist in [country]?", according to various LLMs
I wrote a small program that asks the same Yes/No question about every country to a language model, and generates an SVG world map that visualizes the model's responses:...
1,173 points431 comments3 d ago
- Asking questions to a 0.5b model is hillarious
Yes IK it's supposed to be this dumb, but it's still funny (Qwen2 0.5b Q4\K\M)
1,013 points118 comments6 d ago
- Good Luck Getting a Cheap GPU. AMD Is a 'Data Center First Company,' CEO Says
they are all the same and we ... are too emotional! and yes we already knew that.
920 points240 comments5 d ago
- Qwen be like
Paraphrasing the thinking I saw from Qwen3.8-27B \Hmm, I can take the screenshot, there's a tool for that. But wait, I'm an LLM, I can only read text. \Whatever, let's try calling the tool and see...
898 points114 comments7 d ago
- Users have started buying RTX 5060 Ti 16GB graphics cards en masse for the sake of AI.
Oh look, thats us!
832 points439 comments3 d ago
- Use your phone to monitor anything with local models! Demo of my Open Source and 100% local agent (iOS and Android!)
Hey r/LocalLLaMA ! I made this quick demo of how Observer can run local models to monitor anything with your phone! These are some crazy things I've monitored: When someone that's not me,...
644 points85 comments4 d ago