{"slug": "unsloth-studio", "name": "Unsloth Studio", "category": "ai", "category_name": "AI models and assistants", "description": "", "recommenders": 3, "commenters": 4, "warners": 0, "score": 3.122, "rising": 0.35, "first": "2026-05-20", "latest": "2026-09-04", "why": "Unsloth Studio [0] is what I recommend these days, open source alternative to the more widely known LM Studio", "why_is_quote": true, "has_verdict": false, "sentiment": {"recommend": 5, "neutral": 1, "compare": 0, "warn": 0}, "spark": [0, 0, 0, 0, 0, 0, 1, 1, 2, 1, 0, 0], "listed": true, "loved": [], "caveat": "", "short_quote": "Unsloth Studio [0] is what I recommend these days, open source alternative to the more widely known LM Studio", "icon": true, "domain": "unsloth.ai", "github_repo": null, "official_url": "https://unsloth.ai", "pricing": "", "aliases": ["Unsloth Studio"], "verdict": null, "praise": [{"label": "", "summary": "", "quotes": [{"id": 790959776, "item_id": 49434986, "url": "https://news.ycombinator.com/item?id=49434986", "by": "horsawlarway", "date": "2026-08-25", "stance": "recommend", "quote": "I wanted to point my Home assistant audio satellites at unsloth studio instead of ollama.", "excerpt": "I don't really see a problem. Prior to this it would have been the millions of throw-away \"hello world\" intro projects, or \"todo app\" websites. Hell - think of how many people wrote \"facebook clones\" back in the day. The author is likely still gaining some skills & experience - although they're more likely project management & ops style skills than technical coding skills (ex - what does interaction with this look li", "context": "", "use_case": "local AI for Home Assistant", "switched_from": "Ollama", "story": "Walgit \u2013 a Git server that is one binary in front of an object store"}, {"id": 783782144, "item_id": 48986384, "url": "https://news.ycombinator.com/item?id=48986384", "by": "dofm", "date": "2026-07-20", "stance": "recommend", "quote": "On an M1 Max I have been using either Unsloth Studio (which is basically a web app) or LM Studio", "excerpt": "On an M1 Max I have been using either Unsloth Studio (which is basically a web app) or LM Studio (nicer app on the Mac). You can use the Google AI Edge Gallery to play with the smaller Gemma models (but at the moment the QAT variants don't seem to be there unless I am missing something). I think it's likely the 26B QAT model won't fit in your machine \u2014 you may be able to fit one of the UD_Q3 or UD_Q2 variants but whe", "context": "M1 Max user", "use_case": "running local models", "switched_from": "", "story": "Nativ: Run frontier open models locally on your Mac"}, {"id": 783750384, "item_id": 48984399, "url": "https://news.ycombinator.com/item?id=48984399", "by": "satvikpendem", "date": "2026-07-20", "stance": "recommend", "quote": "Unsloth Studio which is an OSS runner I use is still in progress with MLX support", "excerpt": "Only interesting thing about this vibe coded runner is the MLX support, as that's still annoying to use in other ones, most still use GGUFs. Unsloth Studio which is an OSS runner I use is still in progress with MLX support although it's still a ways away.", "context": "", "use_case": "running local models", "switched_from": "", "story": "Nativ: Run frontier open models locally on your Mac"}, {"id": 774704752, "item_id": 48419047, "url": "https://news.ycombinator.com/item?id=48419047", "by": "satvikpendem", "date": "2026-06-05", "stance": "recommend", "quote": "Try this on Unsloth Studio, they seem to have fixed Gemma tool calling.", "excerpt": "I use it for recommendations rather than knowledge, like recipes or basic stuff like that rather than knowledge, I mean it's likely due to its knowledge cutoff so it's not necessarily accurate. But the agent skills section does have a query Wikipedia tool call. Try this on Unsloth Studio, they seem to have fixed Gemma tool calling.", "context": "", "use_case": "running Gemma with tool calling", "switched_from": "", "story": "Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency"}, {"id": 774696448, "item_id": 48418528, "url": "https://news.ycombinator.com/item?id=48418528", "by": "satvikpendem", "date": "2026-06-05", "stance": "recommend", "quote": "tool calling via Unsloth Studio seems to work just fine with the exact same Gemma models on desktop/server vs the phone.", "excerpt": "I'm running a service in production using Gemma 4 models, to get structured JSON output back from web search tool calls using Unsloth Studio and its API, but it did require a rather large and detailed system prompt and tool call healing if the format wasn't JSON for example (retries, reprompting with feeding the error back into the model, etc, this is also what Unsloth Studio does for its self-healing tool call featu", "context": "runs a production service", "use_case": "serving Gemma with tool calls", "switched_from": "", "story": "Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency"}]}], "caveats": [], "who": [{"by": "dofm", "context": "M1 Max user", "url": "https://news.ycombinator.com/item?id=48986384", "date": "2026-07-20"}, {"by": "satvikpendem", "context": "runs a production service", "url": "https://news.ycombinator.com/item?id=48418528", "date": "2026-06-05"}], "tags": [], "use_cases": ["running local models", "running local llms", "local ai for home assistant", "running gemma with tool calling", "serving gemma with tool calls", "running local llms faster"], "compared": [{"slug": "ollama", "name": "Ollama", "co": 2, "switched_from": 1, "switched_to": 0}, {"slug": "lm-studio", "name": "LM Studio", "co": 4, "switched_from": 0, "switched_to": 0}, {"slug": "llama-cpp", "name": "llama.cpp", "co": 3, "switched_from": 0, "switched_to": 0}, {"slug": "gemma", "name": "Gemma", "co": 3, "switched_from": 0, "switched_to": 0}], "makers": [], "threads": [{"url": "https://news.ycombinator.com/item?id=48982681", "title": "Nativ: Run frontier open models locally on your Mac", "mentions": 2}, {"url": "https://news.ycombinator.com/item?id=48414653", "title": "Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency", "mentions": 2}, {"url": "https://news.ycombinator.com/item?id=49557206", "title": "Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out", "mentions": 1}, {"url": "https://news.ycombinator.com/item?id=49420598", "title": "Walgit \u2013 a Git server that is one binary in front of an object store", "mentions": 1}, {"url": "https://news.ycombinator.com/item?id=48222733", "title": "Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)", "mentions": 1}, {"url": "https://news.ycombinator.com/item?id=48205626", "title": "Qwen3.7-Max: The Agent Frontier", "mentions": 1}], "sentiment_by_month": {"2025-11": {}, "2025-12": {}, "2026-01": {}, "2026-02": {}, "2026-03": {}, "2026-04": {}, "2026-05": {"recommend": 1}, "2026-06": {"recommend": 1}, "2026-07": {"recommend": 2}, "2026-08": {"recommend": 1}, "2026-09": {"neutral": 1}, "2026-10": {}}, "quotes": [{"id": 793011684, "item_id": 49563230, "url": "https://news.ycombinator.com/item?id=49563230", "by": "KronisLV", "date": "2026-09-04", "stance": "neutral", "quote": "I think Unsloth had their own thing as well: https://unsloth.ai/docs/new/studio", "excerpt": "> Download ollama and give it a try Weren't people pissed off at them for a variety of reasons? Not giving attribution etc. In case anyone wants other good alternatives, there's llama.cpp and vLLM, each harder to setup but opens the door for squeezing more performance out of your hardware. I've also heard okay things about LM Studio and I think Unsloth had their own thing as well: https://unsloth.ai/docs/new/studio >", "context": "", "use_case": "running local LLMs", "switched_from": "", "story": "Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out"}, {"id": 790959776, "item_id": 49434986, "url": "https://news.ycombinator.com/item?id=49434986", "by": "horsawlarway", "date": "2026-08-25", "stance": "recommend", "quote": "I wanted to point my Home assistant audio satellites at unsloth studio instead of ollama.", "excerpt": "I don't really see a problem. Prior to this it would have been the millions of throw-away \"hello world\" intro projects, or \"todo app\" websites. Hell - think of how many people wrote \"facebook clones\" back in the day. The author is likely still gaining some skills & experience - although they're more likely project management & ops style skills than technical coding skills (ex - what does interaction with this look li", "context": "", "use_case": "local AI for Home Assistant", "switched_from": "Ollama", "story": "Walgit \u2013 a Git server that is one binary in front of an object store"}, {"id": 783782144, "item_id": 48986384, "url": "https://news.ycombinator.com/item?id=48986384", "by": "dofm", "date": "2026-07-20", "stance": "recommend", "quote": "On an M1 Max I have been using either Unsloth Studio (which is basically a web app) or LM Studio", "excerpt": "On an M1 Max I have been using either Unsloth Studio (which is basically a web app) or LM Studio (nicer app on the Mac). You can use the Google AI Edge Gallery to play with the smaller Gemma models (but at the moment the QAT variants don't seem to be there unless I am missing something). I think it's likely the 26B QAT model won't fit in your machine \u2014 you may be able to fit one of the UD_Q3 or UD_Q2 variants but whe", "context": "M1 Max user", "use_case": "running local models", "switched_from": "", "story": "Nativ: Run frontier open models locally on your Mac"}, {"id": 783750384, "item_id": 48984399, "url": "https://news.ycombinator.com/item?id=48984399", "by": "satvikpendem", "date": "2026-07-20", "stance": "recommend", "quote": "Unsloth Studio which is an OSS runner I use is still in progress with MLX support", "excerpt": "Only interesting thing about this vibe coded runner is the MLX support, as that's still annoying to use in other ones, most still use GGUFs. Unsloth Studio which is an OSS runner I use is still in progress with MLX support although it's still a ways away.", "context": "", "use_case": "running local models", "switched_from": "", "story": "Nativ: Run frontier open models locally on your Mac"}, {"id": 774704752, "item_id": 48419047, "url": "https://news.ycombinator.com/item?id=48419047", "by": "satvikpendem", "date": "2026-06-05", "stance": "recommend", "quote": "Try this on Unsloth Studio, they seem to have fixed Gemma tool calling.", "excerpt": "I use it for recommendations rather than knowledge, like recipes or basic stuff like that rather than knowledge, I mean it's likely due to its knowledge cutoff so it's not necessarily accurate. But the agent skills section does have a query Wikipedia tool call. Try this on Unsloth Studio, they seem to have fixed Gemma tool calling.", "context": "", "use_case": "running Gemma with tool calling", "switched_from": "", "story": "Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency"}, {"id": 774696448, "item_id": 48418528, "url": "https://news.ycombinator.com/item?id=48418528", "by": "satvikpendem", "date": "2026-06-05", "stance": "recommend", "quote": "tool calling via Unsloth Studio seems to work just fine with the exact same Gemma models on desktop/server vs the phone.", "excerpt": "I'm running a service in production using Gemma 4 models, to get structured JSON output back from web search tool calls using Unsloth Studio and its API, but it did require a rather large and detailed system prompt and tool call healing if the format wasn't JSON for example (retries, reprompting with feeding the error back into the model, etc, this is also what Unsloth Studio does for its self-healing tool call featu", "context": "runs a production service", "use_case": "serving Gemma with tool calls", "switched_from": "", "story": "Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency"}, {"id": 771593888, "item_id": 48224618, "url": "https://news.ycombinator.com/item?id=48224618", "by": "satvikpendem", "date": "2026-05-21", "stance": "recommend", "quote": "Unsloth Studio [0] is what I recommend these days, open source alternative to the more widely known LM Studio", "excerpt": "Unsloth Studio [0] is what I recommend these days, open source alternative to the more widely known LM Studio, and also built by the people who make good quantizations of released models. With MTP support not merged in you should get 2x token generation speed with no accuracy difference. They also have MLX quants if you scroll down a bit, which is a format specifically for macOS' Metal GPU acceleration but that's not", "context": "", "use_case": "running local models", "switched_from": "", "story": "Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)"}, {"id": 771407456, "item_id": 48212966, "url": "https://news.ycombinator.com/item?id=48212966", "by": "satvikpendem", "date": "2026-05-20", "stance": "recommend", "quote": "Check out Unsloth Studio it provides MTP support now which 2x the token generation speed with no loss of accuracy", "excerpt": "Check out Unsloth Studio it provides MTP support now which 2x the token generation speed with no loss of accuracy: https://unsloth.ai/docs/models/qwen3.6#mtp-guide", "context": "", "use_case": "running local LLMs faster", "switched_from": "", "story": "Qwen3.7-Max: The Agent Frontier"}]}