{"slug": "llamafile", "name": "llamafile", "category": "ai", "category_name": "AI tools and apps", "description": "", "recommenders": 5, "commenters": 8, "warners": 0, "score": 5.211, "rising": -0.31, "first": "2025-12-13", "latest": "2026-10-27", "why": "Jart's example in her simple LLM-based spam-filter running on a Raspberry Pi", "why_is_quote": true, "has_verdict": false, "sentiment": {"recommend": 5, "neutral": 3, "compare": 0, "warn": 0}, "spark": [0, 0, 1, 0, 1, 1, 1, 0, 0, 0, 0, 1], "listed": true, "loved": [], "caveat": "", "short_quote": "Jart's example in her simple LLM-based spam-filter running on a Raspberry Pi", "kind": "", "icon": true, "domain": null, "github_repo": "github.com/mozilla-ai/llamafile", "official_url": "https://github.com/mozilla-ai/llamafile", "pricing": "", "aliases": ["llamafile", "Llamafile"], "verdict": null, "praise": [{"label": "", "summary": "", "quotes": [{"id": 804242912, "item_id": 50265182, "url": "https://news.ycombinator.com/item?id=50265182", "by": "majorchord", "date": "2026-10-27", "version": null, "stance": "recommend", "quote": "I like to use llamafile for cases like this", "excerpt": "I like to use llamafile for cases like this: https://github.com/mozilla-ai/llamafile", "context": "", "use_case": "offline local LLM", "switched_from": "", "story": "Survival LLM: AI assistant and emergency library that runs on your own computer"}, {"id": 770319648, "item_id": 48144978, "url": "https://news.ycombinator.com/item?id=48144978", "by": "sellmesoap", "date": "2026-05-14", "version": null, "stance": "recommend", "quote": "sounds loke a job for llamafile!", "excerpt": "sounds loke a job for llamafile! https://github.com/mozilla-ai/llamafile", "context": "", "use_case": "Local LLM runtime", "switched_from": "", "story": "Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model"}, {"id": 764631665, "item_id": 47789479, "url": "https://news.ycombinator.com/item?id=47789479", "by": "brabel", "date": "2026-04-15", "version": null, "stance": "recommend", "quote": "I would also recommend llama-file", "excerpt": "Thanks for writing this, I hope people here will actually read this and not assume this is some unfounded hit piece. I was involved a little bit in llama.cpp and knew most of what you wrote and it\u2019s just disgusting how ollama founders behaved! For people looking for alternatives, I would also recommend llama-file, it\u2019s a one file executable for any OS that includes your chosen model: https://github.com/mozilla-ai/lla", "context": "", "use_case": "Single-file local LLM", "switched_from": "", "story": "Stop Using Ollama"}, {"id": 757918384, "item_id": 47369899, "url": "https://news.ycombinator.com/item?id=47369899", "by": "randusername", "date": "2026-03-13", "version": null, "stance": "recommend", "quote": "I'd start with llamafile", "excerpt": "Personally I'd start with llamafile [0] then move to compiling your own llama.cpp. It's not as bad as you might think to compile llama.cpp for your target architecture and spin up an OpenAI compatible API endpoint. It even downloads the models for you. [0]: https://github.com/mozilla-ai/llamafile", "context": "", "use_case": "Local model serving", "switched_from": "", "story": "Can I Run AI locally?"}, {"id": 746453473, "item_id": 46653342, "url": "https://news.ycombinator.com/item?id=46653342", "by": "HanClinto", "date": "2026-01-16", "version": null, "stance": "recommend", "quote": "Jart's example in her simple LLM-based spam-filter running on a Raspberry Pi", "excerpt": "This is a seriously beautiful guide. I really appreciate you putting this together! I especially love the tab-through animations on the various pages, and this is one of the best explanations that I've seen. I generally feel I understand grammar-constrained generation pretty well (I've merged a handful of contributions to the llama.cpp grammar implementation), and yet I still learned some insights from your illustrat", "context": "", "use_case": "", "switched_from": "", "story": "LLM Structured Outputs Handbook"}]}], "caveats": [], "who": [], "tags": [], "use_cases": ["offline local llm", "local llm runtime", "single-file local llm", "local model serving", "distribute single-file llms"], "compared": [{"slug": "llama-cpp", "name": "llama.cpp", "co": 2, "switched_from": 0, "switched_to": 0}], "makers": [{"id": 762690865, "item_id": 47668179, "url": "https://news.ycombinator.com/item?id=47668179", "by": "JohnPDickerson", "date": "2026-04-06", "version": null, "stance": "recommend", "quote": "feel free to check out llamafile - which includes whisperfile, a single-file whisper.cpp + cosmopolitan framework-based executable", "excerpt": "Handy is an awesome project, highly recommended - many of our engineers and PMs use it! CJ, Handy's creator, recently joined us as a Builder in Residence at Mozilla.ai. So for those interested in deploying a more raw/lightweight approach to local speech-to-text (or other multimodal) models, feel free to check out llamafile - which includes whisperfile, a single-file whisper.cpp + cosmopolitan framework-based executab", "context": "works at Mozilla.ai", "use_case": "lightweight local speech-to-text", "switched_from": "", "story": "Show HN: Ghost Pepper \u2013 100% local hold-to-talk speech-to-text for macOS"}], "threads": [{"url": "https://news.ycombinator.com/item?id=46257125", "title": "llamafile: Distribute and Run LLMs with a Single File", "mentions": 2}, {"url": "https://news.ycombinator.com/item?id=50264853", "title": "Survival LLM: AI assistant and emergency library that runs on your own computer", "mentions": 1}, {"url": "https://news.ycombinator.com/item?id=48111896", "title": "Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model", "mentions": 1}, {"url": "https://news.ycombinator.com/item?id=47788385", "title": "Stop Using Ollama", "mentions": 1}, {"url": "https://news.ycombinator.com/item?id=47666024", "title": "Show HN: Ghost Pepper \u2013 100% local hold-to-talk speech-to-text for macOS", "mentions": 1}, {"url": "https://news.ycombinator.com/item?id=47363754", "title": "Can I Run AI locally?", "mentions": 1}], "sentiment_by_month": {"2025-11": {}, "2025-12": {"neutral": 3}, "2026-01": {"recommend": 1}, "2026-02": {}, "2026-03": {"recommend": 1}, "2026-04": {"recommend": 1}, "2026-05": {"recommend": 1}, "2026-06": {}, "2026-07": {}, "2026-08": {}, "2026-09": {}, "2026-10": {"recommend": 1}}, "versions": [], "version_unnamed": 0, "family_ref": null, "runs_on": null, "lines": [], "quotes": [{"id": 804242912, "item_id": 50265182, "url": "https://news.ycombinator.com/item?id=50265182", "by": "majorchord", "date": "2026-10-27", "version": null, "stance": "recommend", "quote": "I like to use llamafile for cases like this", "excerpt": "I like to use llamafile for cases like this: https://github.com/mozilla-ai/llamafile", "context": "", "use_case": "offline local LLM", "switched_from": "", "story": "Survival LLM: AI assistant and emergency library that runs on your own computer"}, {"id": 770319648, "item_id": 48144978, "url": "https://news.ycombinator.com/item?id=48144978", "by": "sellmesoap", "date": "2026-05-14", "version": null, "stance": "recommend", "quote": "sounds loke a job for llamafile!", "excerpt": "sounds loke a job for llamafile! https://github.com/mozilla-ai/llamafile", "context": "", "use_case": "Local LLM runtime", "switched_from": "", "story": "Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model"}, {"id": 764631665, "item_id": 47789479, "url": "https://news.ycombinator.com/item?id=47789479", "by": "brabel", "date": "2026-04-15", "version": null, "stance": "recommend", "quote": "I would also recommend llama-file", "excerpt": "Thanks for writing this, I hope people here will actually read this and not assume this is some unfounded hit piece. I was involved a little bit in llama.cpp and knew most of what you wrote and it\u2019s just disgusting how ollama founders behaved! For people looking for alternatives, I would also recommend llama-file, it\u2019s a one file executable for any OS that includes your chosen model: https://github.com/mozilla-ai/lla", "context": "", "use_case": "Single-file local LLM", "switched_from": "", "story": "Stop Using Ollama"}, {"id": 757918384, "item_id": 47369899, "url": "https://news.ycombinator.com/item?id=47369899", "by": "randusername", "date": "2026-03-13", "version": null, "stance": "recommend", "quote": "I'd start with llamafile", "excerpt": "Personally I'd start with llamafile [0] then move to compiling your own llama.cpp. It's not as bad as you might think to compile llama.cpp for your target architecture and spin up an OpenAI compatible API endpoint. It even downloads the models for you. [0]: https://github.com/mozilla-ai/llamafile", "context": "", "use_case": "Local model serving", "switched_from": "", "story": "Can I Run AI locally?"}, {"id": 746453473, "item_id": 46653342, "url": "https://news.ycombinator.com/item?id=46653342", "by": "HanClinto", "date": "2026-01-16", "version": null, "stance": "recommend", "quote": "Jart's example in her simple LLM-based spam-filter running on a Raspberry Pi", "excerpt": "This is a seriously beautiful guide. I really appreciate you putting this together! I especially love the tab-through animations on the various pages, and this is one of the best explanations that I've seen. I generally feel I understand grammar-constrained generation pretty well (I've merged a handful of contributions to the llama.cpp grammar implementation), and yet I still learned some insights from your illustrat", "context": "", "use_case": "", "switched_from": "", "story": "LLM Structured Outputs Handbook"}, {"id": 742772240, "item_id": 46423265, "url": "https://news.ycombinator.com/item?id=46423265", "by": "niutech", "date": "2025-12-29", "version": null, "stance": "neutral", "quote": "Llamafile (https://llamafile.ai) can easily exceed 4GB due to containing LLM weights inside.", "excerpt": "Llamafile (https://llamafile.ai) can easily exceed 4GB due to containing LLM weights inside. But remember, you cannot run >4GB executable files on Windows.", "context": "", "use_case": "", "switched_from": "", "story": "Binaries"}, {"id": 740169472, "item_id": 46260592, "url": "https://news.ycombinator.com/item?id=46260592", "by": "stlhood", "date": "2025-12-13", "version": null, "stance": "neutral", "quote": "Mozilla is working on it again, and they're asking for input:", "excerpt": "Mozilla is working on it again, and they're asking for input: https://github.com/mozilla-ai/llamafile/discussions/809", "context": "", "use_case": "", "switched_from": "", "story": "llamafile: Distribute and Run LLMs with a Single File"}, {"id": 740163953, "item_id": 46260247, "url": "https://news.ycombinator.com/item?id=46260247", "by": "bear330", "date": "2025-12-13", "version": null, "stance": "neutral", "quote": "just like llamafile", "excerpt": "I built a file sharing CLI called ffl which is also an APE built on Cosmopolitan Libc, just like llamafile. Since llamafiles can be quite large (multi-GB), I built ffl to help 'ship' these single-file binaries easily across different OSs using WebRTC. It feels natural to pair an APE transfer tool with APE AI models. https://github.com/nuwainfo/ffl", "context": "", "use_case": "Distribute single-file LLMs", "switched_from": "", "story": "llamafile: Distribute and Run LLMs with a Single File"}]}