For people looking for alternatives, I would also recommend llama-file, it’s a one file executable for any OS that includes your chosen model: https://github.com/mozilla-ai/llamafile?tab=readme-ov-file It’s truly open source, backed by Mozilla, openly uses llama.cpp and was created by wizard Justine Tunney of CosmopolitanC fame. - Source: Hacker News / 3 months ago

Handy is an awesome project, highly recommended - many of our engineers and PMs use it! CJ, Handy's creator, recently joined us as a Builder in Residence at Mozilla.ai. So for those interested in deploying a more raw/lightweight approach to local speech-to-text (or other multimodal) models, feel free to check out llamafile - which includes whisperfile, a single-file whisper.cpp + cosmopolitan framework-based... - Source: Hacker News / 4 months ago

Personally I'd start with llamafile [0] then move to compiling your own llama.cpp. It's not as bad as you might think to compile llama.cpp for your target architecture and spin up an OpenAI compatible API endpoint. It even downloads the models for you. [0]: https://github.com/mozilla-ai/llamafile. - Source: Hacker News / 5 months ago

> # Avoid issues when wine is installed. > sudo su -c 'echo 0 > /proc/sys/fs/binfmt_misc/status' Please don’t recommend this. If binfmt_misc is enabled, it’s probably for a reason, and disabling it will break things. I have a .NET/Mono app installed that it would break, for example—it’s definitely not just Wine. If binfmt_misc is causing problems, the proper solution is to register the... - Source: Hacker News / 9 months ago

If you like that workflow you might love CheepCode[0] which I built specifically to support it! CheepCode connects to Linear and works on tickets as they roll in, submitting PRs to GitHub. [0] https://cheepcode.com. - Source: Hacker News / about 1 year ago