JACK Audio Connection Kit VS LocalAI

It's linux only, and MIDI only, and it needs GTK2, but yeah, it should work on modern linux. You can use jack[1] to connect the midi output to a softsynth, or another drum software (e.g. Hydrogen[2]) or to actual MIDI hardware. There's a video demo[3] of my program I made 3 years ago. The pasting of drum tab is demoed at 6:20 in the video. [1] https://jackaudio.org/. - Source: Hacker News / 8 months ago

Im pretty sure that asio4all drivers dont run on linux, I think its a windows exclusive driver. But I think that JACK is something similar, Im not sure though, since all I have ever used is windows so I havent had a reason to look into it. Source: 11 months ago

If you're looking for a realtime VST Host, I use Carla with the JACK Audio Connection Kit for low-latency EQ and other FX which are realtime on my Microphone, which then get redirected to a virtual microphone (all on Linux, should still be possible on Windows). So far that worked greatly. Source: 12 months ago

Jack is supported on main platforms . Make sure to read the wiki . Also, some Realtek drivers has the Stereo-mix option that allows you achieve what you want. If yo have the default audio driver that Windows install it may be missing. Source: about 1 year ago

Wonder if a virtual audio cable would help. https://jackaudio.org. Source: about 1 year ago

The $0.47 bill seems reasonable for an experiment, but imagine someone doing a task of this complexity as a daily job - let's say 100x times, or a little more than 4 hours - the bill would be $47/day. It feels like there's still an opportunity for a cheaper solution. Have you or someone else experimented with e.g. https://localai.io/ ? - Source: Hacker News / 5 months ago

We're using LocalAI https://localai.io/ for inference on the back end amongst other tools. Source: 7 months ago

We recently added support to use open-source models by integrating with LocalAI (https://localai.io). With LocalAI, we can run open-source models like Llama2 and seamlessly build LLM applications using LLMStack and run everything on-prem. Source: 8 months ago

- Ability to use local open-source LLMs like Llama2 etc using LocalAI (https://localai.io) Background: We started as a closed source prompt management platform early this year (trypromptly.com) and eventually landed as an Enterprise LLM apps platform. In the process, we learned how hard it is to sell a horizontal SaaS platform. That combined with the concerns around data privacy (both with us hosting data as well... - Source: Hacker News / 8 months ago

LocalAI https://localai.io/ and LMStudio https://lmstudio.ai/ both have fairly complete OpenAI compatibility layers. llama-cpp-python has a FastAPI server as well: https://github.com/abetlen/llama-cpp-python/blob/main/llama_... (as of this moment it hasn't merged GGUF update yet though). - Source: Hacker News / 8 months ago