{"slug": "gemma-4-31b", "name": "Gemma 4 31B", "category": "ai", "category_name": "AI models and assistants", "description": "A 31B-parameter open-weights language model from Google's Gemma 4 family.", "recommenders": 5, "commenters": 9, "warners": 0, "score": 5.527, "rising": -0.31, "first": "2026-05-11", "latest": "2026-10-09", "why": "HN commenters rate it among the best models to run at home and use it for local agentic coding and simple tasks like data extraction or trivial refactors.", "why_is_quote": false, "has_verdict": true, "sentiment": {"recommend": 5, "neutral": 2, "compare": 2, "warn": 0}, "spark": [0, 0, 0, 0, 0, 0, 1, 3, 0, 1, 0, 0], "listed": true, "loved": ["Strong local model", "Agentic coding"], "caveat": "Not frontier-level", "short_quote": "the best models you can run at home are probably Qwen 3.6 27B and Gemma 4 31B", "icon": true, "domain": null, "github_repo": null, "official_url": "https://ai.google.dev/gemma", "pricing": "free", "aliases": ["Gemma 4 31B", "Gemma4:31B", "Gemma4-31b"], "verdict": [{"text": "HN commenters rate it among the best models to run at home", "cites": [{"id": 788644963, "item_id": 49290310, "url": "https://news.ycombinator.com/item?id=49290310", "by": "SwellJoe", "date": "2026-08-13", "stance": "recommend", "quote": "the best models you can run at home are probably Qwen 3.6 27B and Gemma 4 31B", "excerpt": "\"used to\" in your sentence already answers your curiosity. ROCm runs most things just fine without any ceremony or difficulty. I have a couple of the same cards as covered in the article, bought before they got expensive (I'd recommend current Radeon AI Pro 9700 cards over the V620 now, though, as they have increased in price since I bought mine), and they're at the long end of the supported chart for ROCm...nearly E", "context": "", "use_case": "local models", "switched_from": "", "story": "We Have AI at Home Chapter 1: A Box of Scraps"}, {"id": 776600530, "item_id": 48537533, "url": "https://news.ycombinator.com/item?id=48537533", "by": "xiaoyu2006", "date": "2026-06-14", "stance": "neutral", "quote": "Running llamacpp with Q4KM Qwen 3.6 27B or Gemma 4 31B", "excerpt": "V100 32G SXM2 adapted to PCIE. Running llamacpp with Q4KM Qwen 3.6 27B or Gemma 4 31B. I use them when I feel of privacy is important or I just want to mess around.", "context": "", "use_case": "local LLM for privacy", "switched_from": "", "story": "Ask HN: What does your local LLM setup looks like?"}]}, {"text": " and use it for local agentic coding and simple tasks like data extraction or trivial refactors.", "cites": [{"id": 776726593, "item_id": 48545412, "url": "https://news.ycombinator.com/item?id=48545412", "by": "jodoherty", "date": "2026-06-15", "stance": "recommend", "quote": "I find it useful.", "excerpt": "I use pi with an RTX Pro 6000 Blackwell to run Gemma 4 31b to do all my agentic coding. I find it useful. This side project highlights a similar approach to how I scope and tackle projects at work now: https://git.theodohertyfamily.com/wg-wrap.git/tree/README.md https://git.theodohertyfamily.com/wg-wrap.git/tree/CASE_STUDY.md You have to apply a lot of careful architecture and TDD to your approach. Eliminate technica", "context": "uses local model for daily coding at work", "use_case": "local agentic coding", "switched_from": "", "story": "Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?"}, {"id": 800403124, "item_id": 50025195, "url": "https://news.ycombinator.com/item?id=50025195", "by": "aftbit", "date": "2026-10-09", "stance": "neutral", "quote": "or even to self-hosted Gemma4:31B", "excerpt": "I have had good luck rotating between the three tiers of GPT 5.6 with occasional jumps up to Astra or Fable. Most of my work is with GPT-5.6-Sol. Simple tasks like data extraction or trivial refactors (rename this variable etc) I often push down to Terra or Luna, or even to self-hosted Gemma4:31B. Very tricky stuff, like planning a new feature, design review, or code review of a complex change across multiple reposit", "context": "", "use_case": "trivial refactors, data extraction", "switched_from": "", "story": "Why isn't the industry freaking out about DeepSeek 4.1 Flash?"}, {"id": 778893923, "item_id": 48680870, "url": "https://news.ycombinator.com/item?id=48680870", "by": "kylenessen", "date": "2026-06-25", "stance": "recommend", "quote": "Gemma4-31b is working well for me on these types of tasks", "excerpt": "I really wanted to like this, but unfortunately couldn't see how it improves my experience over Obsidian or VS Code. The fact that I have to juggle between OpenKnowledge and Codex to engage the AI, while also accepting a barebones Obsidian, is a real bummer. From what I can tell, you are saving me a few key strokes with moving prompts around. What I really want is the AI to live IN the app, like VS Code, and then mov", "context": "", "use_case": "local model for notes tasks", "switched_from": "", "story": "Show HN: OpenKnowledge \u2013 open-source alternative to Obsidian/Notion"}]}, {"text": " The main caveat is that it falls far short of frontier models like Sonnet or Opus on anything requiring real reasoning", "cites": [{"id": 770718752, "item_id": 48169922, "url": "https://news.ycombinator.com/item?id=48169922", "by": "jwr", "date": "2026-05-17", "stance": "compare", "quote": "they are NOWHERE near the huge models like Sonnet or Opus. Nowhere.", "excerpt": "> \"run a model like Gemma 4 31b, which is almost anthropic sonnet levels of performance\" I wish people stopped deluding themselves \u2014 I regularly try (and benchmark for my purposes) local models and they are NOWHERE near the huge models like Sonnet or Opus. Nowhere. Yes, you can sometimes get plausibly-looking output for simple tasks, but for anything even remotely requiring thinking there is simply no comparison. Loc", "context": "benchmarks local models regularly", "use_case": "local model benchmarking", "switched_from": "", "story": "Apple Silicon costs more than OpenRouter"}]}, {"text": ", and one commenter finds Qwen 3.6 27B faster, smarter and more memory-efficient.", "cites": [{"id": 770705554, "item_id": 48169097, "url": "https://news.ycombinator.com/item?id=48169097", "by": "sleepyeldrazi", "date": "2026-05-17", "stance": "compare", "quote": "I assume the 31B gemma has cases in which it edges out, I've just failed finding any", "excerpt": "If you want a good dense model, use qwen3.6 27B instead, speed will be up, and if you don't take my word for it being smarter, take openrouter's prices of it against the bigger, slower and less memory-efficient gemma do the talking. If you want a faster model, go for qwen3.6 35B (or gemma 4 26B if gemma models perform better for your tasks). There is a reason why people (myself included) haven't shut up about those t", "context": "", "use_case": "", "switched_from": "", "story": "Apple Silicon costs more than OpenRouter"}]}], "praise": [{"label": "Strong local model", "summary": "Named among the best models you can run at home, often alongside Qwen 3.6 27B.", "quotes": [{"id": 788644963, "item_id": 49290310, "url": "https://news.ycombinator.com/item?id=49290310", "by": "SwellJoe", "date": "2026-08-13", "stance": "recommend", "quote": "the best models you can run at home are probably Qwen 3.6 27B and Gemma 4 31B", "excerpt": "\"used to\" in your sentence already answers your curiosity. ROCm runs most things just fine without any ceremony or difficulty. I have a couple of the same cards as covered in the article, bought before they got expensive (I'd recommend current Radeon AI Pro 9700 cards over the V620 now, though, as they have increased in price since I bought mine), and they're at the long end of the supported chart for ROCm...nearly E", "context": "", "use_case": "local models", "switched_from": "", "story": "We Have AI at Home Chapter 1: A Box of Scraps"}, {"id": 776600530, "item_id": 48537533, "url": "https://news.ycombinator.com/item?id=48537533", "by": "xiaoyu2006", "date": "2026-06-14", "stance": "neutral", "quote": "Running llamacpp with Q4KM Qwen 3.6 27B or Gemma 4 31B", "excerpt": "V100 32G SXM2 adapted to PCIE. Running llamacpp with Q4KM Qwen 3.6 27B or Gemma 4 31B. I use them when I feel of privacy is important or I just want to mess around.", "context": "", "use_case": "local LLM for privacy", "switched_from": "", "story": "Ask HN: What does your local LLM setup looks like?"}, {"id": 769478337, "item_id": 48092396, "url": "https://news.ycombinator.com/item?id=48092396", "by": "almogodel", "date": "2026-05-11", "stance": "recommend", "quote": "It\u2019s Qwen 3.6 27B with Gemma 4 31B, both unquantized, bf16/fp16", "excerpt": "Remember nodes and graphs? A comfy user interface allows pretty incredible wiring among models local ai is like eurorack. The current graph skews heavily towards a a pair of small dense models collaborating with the large heavyweights selectively. It\u2019s Qwen 3.6 27B with Gemma 4 31B, both unquantized, bf16/fp16, with phi 14b, nemotron cascade 2, and then those large heavyweights, r1 and subsequent deepseek models incl", "context": "", "use_case": "local multi-model graph", "switched_from": "", "story": "Local AI needs to be the norm"}]}, {"label": "Agentic coding", "summary": "One commenter runs it for all their agentic coding and finds it useful.", "quotes": [{"id": 776726593, "item_id": 48545412, "url": "https://news.ycombinator.com/item?id=48545412", "by": "jodoherty", "date": "2026-06-15", "stance": "recommend", "quote": "I find it useful.", "excerpt": "I use pi with an RTX Pro 6000 Blackwell to run Gemma 4 31b to do all my agentic coding. I find it useful. This side project highlights a similar approach to how I scope and tackle projects at work now: https://git.theodohertyfamily.com/wg-wrap.git/tree/README.md https://git.theodohertyfamily.com/wg-wrap.git/tree/CASE_STUDY.md You have to apply a lot of careful architecture and TDD to your approach. Eliminate technica", "context": "uses local model for daily coding at work", "use_case": "local agentic coding", "switched_from": "", "story": "Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?"}, {"id": 778893923, "item_id": 48680870, "url": "https://news.ycombinator.com/item?id=48680870", "by": "kylenessen", "date": "2026-06-25", "stance": "recommend", "quote": "Gemma4-31b is working well for me on these types of tasks", "excerpt": "I really wanted to like this, but unfortunately couldn't see how it improves my experience over Obsidian or VS Code. The fact that I have to juggle between OpenKnowledge and Codex to engage the AI, while also accepting a barebones Obsidian, is a real bummer. From what I can tell, you are saving me a few key strokes with moving prompts around. What I really want is the AI to live IN the app, like VS Code, and then mov", "context": "", "use_case": "local model for notes tasks", "switched_from": "", "story": "Show HN: OpenKnowledge \u2013 open-source alternative to Obsidian/Notion"}]}, {"label": "Simple tasks", "summary": "Used for easy work like data extraction and trivial refactors.", "quotes": [{"id": 800403124, "item_id": 50025195, "url": "https://news.ycombinator.com/item?id=50025195", "by": "aftbit", "date": "2026-10-09", "stance": "neutral", "quote": "or even to self-hosted Gemma4:31B", "excerpt": "I have had good luck rotating between the three tiers of GPT 5.6 with occasional jumps up to Astra or Fable. Most of my work is with GPT-5.6-Sol. Simple tasks like data extraction or trivial refactors (rename this variable etc) I often push down to Terra or Luna, or even to self-hosted Gemma4:31B. Very tricky stuff, like planning a new feature, design review, or code review of a complex change across multiple reposit", "context": "", "use_case": "trivial refactors, data extraction", "switched_from": "", "story": "Why isn't the industry freaking out about DeepSeek 4.1 Flash?"}]}, {"label": "Privacy", "summary": "Run locally when privacy matters.", "quotes": [{"id": 776600530, "item_id": 48537533, "url": "https://news.ycombinator.com/item?id=48537533", "by": "xiaoyu2006", "date": "2026-06-14", "stance": "neutral", "quote": "Running llamacpp with Q4KM Qwen 3.6 27B or Gemma 4 31B", "excerpt": "V100 32G SXM2 adapted to PCIE. Running llamacpp with Q4KM Qwen 3.6 27B or Gemma 4 31B. I use them when I feel of privacy is important or I just want to mess around.", "context": "", "use_case": "local LLM for privacy", "switched_from": "", "story": "Ask HN: What does your local LLM setup looks like?"}]}, {"label": "Creative writing", "summary": "Reported secondhand to be highly regarded for creative writing, especially its finetunes.", "quotes": [{"id": 774659232, "item_id": 48416202, "url": "https://news.ycombinator.com/item?id=48416202", "by": "KludgeShySir", "date": "2026-06-05", "stance": "recommend", "quote": "Gemma4-31b seems to be very highly regarded for creative writing, especially its finetunes.", "excerpt": "Gemma4-31b seems to be very highly regarded for creative writing, especially its finetunes. As for comparison to E4B, I can't say. Creative writing is not my focus, so this is only secondhand information. r/LocalLlama tends to focus more on the technical side; if you want more creative side check out r/SillyTavern as well (but type of info does bleed over between them).", "context": "secondhand information", "use_case": "creative writing", "switched_from": "", "story": "Gemma 4 12B: A unified, encoder-free multimodal model"}]}], "caveats": [{"label": "Not frontier-level", "summary": "A commenter who benchmarks local models says they are nowhere near Sonnet or Opus for tasks needing reasoning.", "quotes": [{"id": 770718752, "item_id": 48169922, "url": "https://news.ycombinator.com/item?id=48169922", "by": "jwr", "date": "2026-05-17", "stance": "compare", "quote": "they are NOWHERE near the huge models like Sonnet or Opus. Nowhere.", "excerpt": "> \"run a model like Gemma 4 31b, which is almost anthropic sonnet levels of performance\" I wish people stopped deluding themselves \u2014 I regularly try (and benchmark for my purposes) local models and they are NOWHERE near the huge models like Sonnet or Opus. Nowhere. Yes, you can sometimes get plausibly-looking output for simple tasks, but for anything even remotely requiring thinking there is simply no comparison. Loc", "context": "benchmarks local models regularly", "use_case": "local model benchmarking", "switched_from": "", "story": "Apple Silicon costs more than OpenRouter"}]}, {"label": "Qwen often better", "summary": "One commenter says Qwen 3.6 27B is faster and smarter, and Gemma 4 31B is bigger, slower and less memory-efficient.", "quotes": [{"id": 770705554, "item_id": 48169097, "url": "https://news.ycombinator.com/item?id=48169097", "by": "sleepyeldrazi", "date": "2026-05-17", "stance": "compare", "quote": "I assume the 31B gemma has cases in which it edges out, I've just failed finding any", "excerpt": "If you want a good dense model, use qwen3.6 27B instead, speed will be up, and if you don't take my word for it being smarter, take openrouter's prices of it against the bigger, slower and less memory-efficient gemma do the talking. If you want a faster model, go for qwen3.6 35B (or gemma 4 26B if gemma models perform better for your tasks). There is a reason why people (myself included) haven't shut up about those t", "context": "", "use_case": "", "switched_from": "", "story": "Apple Silicon costs more than OpenRouter"}]}, {"label": "Needs careful scoping", "summary": "Getting good coding results takes careful architecture and TDD.", "quotes": [{"id": 776726593, "item_id": 48545412, "url": "https://news.ycombinator.com/item?id=48545412", "by": "jodoherty", "date": "2026-06-15", "stance": "recommend", "quote": "I find it useful.", "excerpt": "I use pi with an RTX Pro 6000 Blackwell to run Gemma 4 31b to do all my agentic coding. I find it useful. This side project highlights a similar approach to how I scope and tackle projects at work now: https://git.theodohertyfamily.com/wg-wrap.git/tree/README.md https://git.theodohertyfamily.com/wg-wrap.git/tree/CASE_STUDY.md You have to apply a lot of careful architecture and TDD to your approach. Eliminate technica", "context": "uses local model for daily coding at work", "use_case": "local agentic coding", "switched_from": "", "story": "Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?"}]}], "who": [{"by": "jodoherty", "context": "uses local model for daily coding at work", "url": "https://news.ycombinator.com/item?id=48545412", "date": "2026-06-15"}, {"by": "KludgeShySir", "context": "secondhand information", "url": "https://news.ycombinator.com/item?id=48416202", "date": "2026-06-05"}], "tags": ["self-hostable", "for local coding agents", "for privacy-sensitive work", "for llama.cpp users", "for creative writing"], "use_cases": ["trivial refactors, data extraction", "local models", "local model for notes tasks", "local agentic coding", "local llm for privacy", "creative writing"], "compared": [{"slug": "qwen-3-6", "name": "Qwen 3.6", "co": 5, "switched_from": 0, "switched_to": 0}, {"slug": "llama-cpp", "name": "llama.cpp", "co": 4, "switched_from": 0, "switched_to": 0}, {"slug": "gemini", "name": "Gemini", "co": 2, "switched_from": 0, "switched_to": 0}, {"slug": "codex", "name": "Codex", "co": 2, "switched_from": 0, "switched_to": 0}, {"slug": "pi", "name": "Pi", "co": 2, "switched_from": 0, "switched_to": 0}], "makers": [], "threads": [{"url": "https://news.ycombinator.com/item?id=48168198", "title": "Apple Silicon costs more than OpenRouter", "mentions": 2}, {"url": "https://news.ycombinator.com/item?id=50000488", "title": "Why isn't the industry freaking out about DeepSeek 4.1 Flash?", "mentions": 1}, {"url": "https://news.ycombinator.com/item?id=49288293", "title": "We Have AI at Home Chapter 1: A Box of Scraps", "mentions": 1}, {"url": "https://news.ycombinator.com/item?id=48675435", "title": "Show HN: OpenKnowledge \u2013 open-source alternative to Obsidian/Notion", "mentions": 1}, {"url": "https://news.ycombinator.com/item?id=48542100", "title": "Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?", "mentions": 1}, {"url": "https://news.ycombinator.com/item?id=48536531", "title": "Ask HN: What does your local LLM setup looks like?", "mentions": 1}], "sentiment_by_month": {"2025-11": {}, "2025-12": {}, "2026-01": {}, "2026-02": {}, "2026-03": {}, "2026-04": {}, "2026-05": {"recommend": 1, "compare": 2}, "2026-06": {"recommend": 3, "neutral": 1}, "2026-07": {}, "2026-08": {"recommend": 1}, "2026-09": {}, "2026-10": {"neutral": 1}}, "quotes": [{"id": 800403124, "item_id": 50025195, "url": "https://news.ycombinator.com/item?id=50025195", "by": "aftbit", "date": "2026-10-09", "stance": "neutral", "quote": "or even to self-hosted Gemma4:31B", "excerpt": "I have had good luck rotating between the three tiers of GPT 5.6 with occasional jumps up to Astra or Fable. Most of my work is with GPT-5.6-Sol. Simple tasks like data extraction or trivial refactors (rename this variable etc) I often push down to Terra or Luna, or even to self-hosted Gemma4:31B. Very tricky stuff, like planning a new feature, design review, or code review of a complex change across multiple reposit", "context": "", "use_case": "trivial refactors, data extraction", "switched_from": "", "story": "Why isn't the industry freaking out about DeepSeek 4.1 Flash?"}, {"id": 788644963, "item_id": 49290310, "url": "https://news.ycombinator.com/item?id=49290310", "by": "SwellJoe", "date": "2026-08-13", "stance": "recommend", "quote": "the best models you can run at home are probably Qwen 3.6 27B and Gemma 4 31B", "excerpt": "\"used to\" in your sentence already answers your curiosity. ROCm runs most things just fine without any ceremony or difficulty. I have a couple of the same cards as covered in the article, bought before they got expensive (I'd recommend current Radeon AI Pro 9700 cards over the V620 now, though, as they have increased in price since I bought mine), and they're at the long end of the supported chart for ROCm...nearly E", "context": "", "use_case": "local models", "switched_from": "", "story": "We Have AI at Home Chapter 1: A Box of Scraps"}, {"id": 778893923, "item_id": 48680870, "url": "https://news.ycombinator.com/item?id=48680870", "by": "kylenessen", "date": "2026-06-25", "stance": "recommend", "quote": "Gemma4-31b is working well for me on these types of tasks", "excerpt": "I really wanted to like this, but unfortunately couldn't see how it improves my experience over Obsidian or VS Code. The fact that I have to juggle between OpenKnowledge and Codex to engage the AI, while also accepting a barebones Obsidian, is a real bummer. From what I can tell, you are saving me a few key strokes with moving prompts around. What I really want is the AI to live IN the app, like VS Code, and then mov", "context": "", "use_case": "local model for notes tasks", "switched_from": "", "story": "Show HN: OpenKnowledge \u2013 open-source alternative to Obsidian/Notion"}, {"id": 776726593, "item_id": 48545412, "url": "https://news.ycombinator.com/item?id=48545412", "by": "jodoherty", "date": "2026-06-15", "stance": "recommend", "quote": "I find it useful.", "excerpt": "I use pi with an RTX Pro 6000 Blackwell to run Gemma 4 31b to do all my agentic coding. I find it useful. This side project highlights a similar approach to how I scope and tackle projects at work now: https://git.theodohertyfamily.com/wg-wrap.git/tree/README.md https://git.theodohertyfamily.com/wg-wrap.git/tree/CASE_STUDY.md You have to apply a lot of careful architecture and TDD to your approach. Eliminate technica", "context": "uses local model for daily coding at work", "use_case": "local agentic coding", "switched_from": "", "story": "Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?"}, {"id": 776600530, "item_id": 48537533, "url": "https://news.ycombinator.com/item?id=48537533", "by": "xiaoyu2006", "date": "2026-06-14", "stance": "neutral", "quote": "Running llamacpp with Q4KM Qwen 3.6 27B or Gemma 4 31B", "excerpt": "V100 32G SXM2 adapted to PCIE. Running llamacpp with Q4KM Qwen 3.6 27B or Gemma 4 31B. I use them when I feel of privacy is important or I just want to mess around.", "context": "", "use_case": "local LLM for privacy", "switched_from": "", "story": "Ask HN: What does your local LLM setup looks like?"}, {"id": 774659232, "item_id": 48416202, "url": "https://news.ycombinator.com/item?id=48416202", "by": "KludgeShySir", "date": "2026-06-05", "stance": "recommend", "quote": "Gemma4-31b seems to be very highly regarded for creative writing, especially its finetunes.", "excerpt": "Gemma4-31b seems to be very highly regarded for creative writing, especially its finetunes. As for comparison to E4B, I can't say. Creative writing is not my focus, so this is only secondhand information. r/LocalLlama tends to focus more on the technical side; if you want more creative side check out r/SillyTavern as well (but type of info does bleed over between them).", "context": "secondhand information", "use_case": "creative writing", "switched_from": "", "story": "Gemma 4 12B: A unified, encoder-free multimodal model"}, {"id": 770718752, "item_id": 48169922, "url": "https://news.ycombinator.com/item?id=48169922", "by": "jwr", "date": "2026-05-17", "stance": "compare", "quote": "they are NOWHERE near the huge models like Sonnet or Opus. Nowhere.", "excerpt": "> \"run a model like Gemma 4 31b, which is almost anthropic sonnet levels of performance\" I wish people stopped deluding themselves \u2014 I regularly try (and benchmark for my purposes) local models and they are NOWHERE near the huge models like Sonnet or Opus. Nowhere. Yes, you can sometimes get plausibly-looking output for simple tasks, but for anything even remotely requiring thinking there is simply no comparison. Loc", "context": "benchmarks local models regularly", "use_case": "local model benchmarking", "switched_from": "", "story": "Apple Silicon costs more than OpenRouter"}, {"id": 770705554, "item_id": 48169097, "url": "https://news.ycombinator.com/item?id=48169097", "by": "sleepyeldrazi", "date": "2026-05-17", "stance": "compare", "quote": "I assume the 31B gemma has cases in which it edges out, I've just failed finding any", "excerpt": "If you want a good dense model, use qwen3.6 27B instead, speed will be up, and if you don't take my word for it being smarter, take openrouter's prices of it against the bigger, slower and less memory-efficient gemma do the talking. If you want a faster model, go for qwen3.6 35B (or gemma 4 26B if gemma models perform better for your tasks). There is a reason why people (myself included) haven't shut up about those t", "context": "", "use_case": "", "switched_from": "", "story": "Apple Silicon costs more than OpenRouter"}, {"id": 769478337, "item_id": 48092396, "url": "https://news.ycombinator.com/item?id=48092396", "by": "almogodel", "date": "2026-05-11", "stance": "recommend", "quote": "It\u2019s Qwen 3.6 27B with Gemma 4 31B, both unquantized, bf16/fp16", "excerpt": "Remember nodes and graphs? A comfy user interface allows pretty incredible wiring among models local ai is like eurorack. The current graph skews heavily towards a a pair of small dense models collaborating with the large heavyweights selectively. It\u2019s Qwen 3.6 27B with Gemma 4 31B, both unquantized, bf16/fp16, with phi 14b, nemotron cascade 2, and then those large heavyweights, r1 and subsequent deepseek models incl", "context": "", "use_case": "local multi-model graph", "switched_from": "", "story": "Local AI needs to be the norm"}]}