{ "subreddit": "r/LocalLLM", "page": "https://redlisten.com/r/localllm", "updated": "2026-11-12T10:13:29.722Z", "members": 265012, "activity": { "posts_last_24_hours": "100+", "posts_per_hour": 5.7, "comments_per_hour": 26.1, "newest_post_utc": 1794477835.834, "newest_comment_utc": 1794429313 }, "top_threads_this_week": [ { "title": "Qwopeful 🤞🏼", "score": 1213, "comments": 247, "created_utc": 1794152518.127, "snippet": "", "url": "https://www.reddit.com/r/LocalLLM/comments/1xr1ax4/qwopeful/" }, { "title": "I removed guardrails from Qwen and it is performing EPICALLY", "score": 934, "comments": 202, "created_utc": 1793944085.131, "snippet": "Ok ok, I am still doing tests but here is the story: I have a small custom harness (who doesn't!) that does pretty complicated stuff. I am using Claude (subscription) and everything is great. In...", "url": "https://www.reddit.com/r/LocalLLM/comments/1xp56x6/i_removed_guardrails_from_qwen_and_it_is/" }, { "title": "Running GLM 5.3 Flash on a 40 mini PC cluster via USB 3 interconnects at 14 tps", "score": 606, "comments": 172, "created_utc": 1794309108.515, "snippet": "Hello! Here is a rack I made using 40 mini PCs I happened to have from a different project: Intel N150 12 GB DDR5 4800 - physical bandwidth limit around 33GBs Diskless nodes and they are connected...", "url": "https://www.reddit.com/r/LocalLLM/comments/1xsk8n9/running_glm_53_flash_on_a_40_mini_pc_cluster_via/" }, { "title": "Probably old news, but any website you have open can reach your local LLM server while you browse", "score": 513, "comments": 149, "created_utc": 1794139252.282, "snippet": "Maybe this is obvious to everyone but me, but it only clicked yesterday. If you run llama.cpp / vLLM / or whatever on localhost with the default config, a random website you have open in another...", "url": "https://www.reddit.com/r/LocalLLM/comments/1xqwuhb/probably_old_news_but_any_website_you_have_open/" }, { "title": "Is bro right? Local is a pipe dream?", "score": 477, "comments": 618, "created_utc": 1793887881.533, "snippet": "https://x.com/matt503ea5sf9z5/status/2118155162376458298?a=4bUWTuzbF\\LcVwWBUDk&s=19 Interesting post, I hear a different story with dgx sparks how people are optimizing models to run upwards of...", "url": "https://www.reddit.com/r/LocalLLM/comments/1xojme6/is_bro_right_local_is_a_pipe_dream/" }, { "title": "DDR4 512GB vs. switching to DDR5 for MoE offload on a multi-GPU rig?", "score": 472, "comments": 171, "created_utc": 1793982356.455, "snippet": "Setup: (if finished - still under construction, partly watercooled) Threadripper PRO 5995WX, ASUS WRX80E-SAGE SE WIFI II 6× RTX PRO 6000 8× RTX 5090 4× RTX 3090 128 GB DDR4 (that’s the problem) I...", "url": "https://www.reddit.com/r/LocalLLM/comments/1xph2dn/ddr4_512gb_vs_switching_to_ddr5_for_moe_offload/" }, { "title": "2x RTX PRO 6000 running DeepSeek-V4-Flash (284B) fully offline: 1,170 tok/s peak", "score": 362, "comments": 89, "created_utc": 1793884205.976, "snippet": "We build these boxes, so here's the honest test log from our own unit, network cable unplugged. Setup: 2x RTX PRO 6000 Blackwell (192 GB), EPYC 9124, 377 GB RAM, vLLM, TP2, no NVLink. The model...", "url": "https://www.reddit.com/r/LocalLLM/comments/1xoi8wi/2x_rtx_pro_6000_running_deepseekv4flash_284b/" }, { "title": "Me when Chinese models", "score": 346, "comments": 31, "created_utc": 1794329216.742, "snippet": "", "url": "https://www.reddit.com/r/LocalLLM/comments/1xsrvhm/me_when_chinese_models/" }, { "title": "Qwen3.8 27B FP8 on 4× Radeon AI PRO R9700: 7K tok/s prefill, 814 tok/s C8 decode", "score": 297, "comments": 157, "created_utc": 1793930935.604, "snippet": "Working on a full inference stack for 4xr9700, wanted to share progress so far. All GPUs are capped at 210w(so plugs into any normal 15a outlet). BF16 KV, MTP enabled(no spec). \\ Latency...", "url": "https://www.reddit.com/r/LocalLLM/comments/1xp127a/qwen38_27b_fp8_on_4_radeon_ai_pro_r9700_7k_toks/" }, { "title": "Opus 5.5 wrote its own quantiser for Qwen3.5-0.8B, no llama-quantize, no imatrix. 5.9× better than Unsloth's same-size file.", "score": 231, "comments": 44, "created_utc": 1794063282.376, "snippet": "Inspired by Weight Space Programming (MIT CSAIL, Nov 2), but in the end Opus 5.5 did its own thing: no weight-space technique was used. It wrote a quantiser from scratch in NumPy and made every...", "url": "https://www.reddit.com/r/LocalLLM/comments/1xq889l/opus_55_wrote_its_own_quantiser_for_qwen3508b_no/" } ], "newest_posts": [ { "title": "The Judge Cannot Be the Defendant", "score": 1, "comments": 0, "created_utc": 1794477835.834, "url": "https://www.reddit.com/r/LocalLLM/comments/1xu8ycf/the_judge_cannot_be_the_defendant/" }, { "title": "Hypothesis :- I think so we can say Goodbye to Open weights / Open Source AI models and especially LLMs because Jensen Huang an avid supporter of open weight ai models is Targeted heavily with negative marketing.", "score": 1, "comments": 0, "created_utc": 1794477414.521, "url": "https://www.reddit.com/r/LocalLLM/comments/1xu8u34/hypothesis_i_think_so_we_can_say_goodbye_to_open/" }, { "title": "Curated list of resources for the topic of Quantization for beginners", "score": 1, "comments": 0, "created_utc": 1794476934.014, "url": "https://www.reddit.com/r/LocalLLM/comments/1xu8pfm/curated_list_of_resources_for_the_topic_of/" }, { "title": "AI is a pipe dream", "score": 1, "comments": 0, "created_utc": 1794476856.69, "url": "https://www.reddit.com/r/LocalLLM/comments/1xu8opv/ai_is_a_pipe_dream/" }, { "title": "I'm building an open-source inference engine to run models on the GPUs you already own (got V100 Tensor Cores working again: 30B model 6.7 s/token -> 0.33 s on two cards)", "score": 1, "comments": 0, "created_utc": 1794476748.78, "url": "https://www.reddit.com/r/LocalLLM/comments/1xu8nq8/im_building_an_opensource_inference_engine_to_run/" }, { "title": "Upgrade path for small selfemployed", "score": 1, "comments": 0, "created_utc": 1794476265.057, "url": "https://www.reddit.com/r/LocalLLM/comments/1xu8jav/upgrade_path_for_small_selfemployed/" }, { "title": "LM Studio + MCP + plugin for Godot engine?", "score": 1, "comments": 0, "created_utc": 1794475340.195, "url": "https://www.reddit.com/r/LocalLLM/comments/1xu8axv/lm_studio_mcp_plugin_for_godot_engine/" }, { "title": "Best uncensored local model for reverse engineering / Ghidra on a 16GB RX 6800 + 32GB RAM? (Speed doesn't matter)", "score": 1, "comments": 0, "created_utc": 1794475213.04, "url": "https://www.reddit.com/r/LocalLLM/comments/1xu89se/best_uncensored_local_model_for_reverse/" }, { "title": "What would you suggest on running Mac Studio 256gb?", "score": 1, "comments": 0, "created_utc": 1794473639.957, "url": "https://www.reddit.com/r/LocalLLM/comments/1xu7uvn/what_would_you_suggest_on_running_mac_studio_256gb/" }, { "title": "Head replacement", "score": 1, "comments": 0, "created_utc": 1794472427.49, "url": "https://www.reddit.com/r/LocalLLM/comments/1xu7jta/head_replacement/" } ], "words_this_week": [ { "word": "model", "titles": 23 }, { "word": "flash", "titles": 22 }, { "word": "models", "titles": 20 }, { "word": "qwen3", "titles": 17 }, { "word": "ram", "titles": 17 }, { "word": "open", "titles": 16 }, { "word": "qwen", "titles": 14 }, { "word": "running", "titles": 14 }, { "word": "run", "titles": 14 }, { "word": "rtx", "titles": 13 }, { "word": "pro", "titles": 12 }, { "word": "27b", "titles": 12 } ], "preview": "This is a preview. Every post and comment in r/LocalLLM, live, as JSON or RSS on the same paths a Reddit client uses, plus keyword streams to Slack, Discord, webhook or email, needs a free key: https://app.redlisten.com/?signup=1&utm_source=redlisten&utm_medium=subreddit", "docs": "https://redlisten.com/docs", "attribution": "Source: Redlisten, https://redlisten.com/r/localllm" }