
Plexe
Fireworks AI
Unsloth
SMOL-GPT
Minimax Platform
EZmodel
Mistral Forge
nanoGPT
llama.cpp
LM Studio
Ollama
Ava PLS
Hugging Face
opencode
Lemonade Server
Podman
Based on our record, llama.cpp seems to be more popular. It has been mentiond 18 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
It's from https://github.com/ggml-org/llama.cpp -- not associated with Meta, it's been around for years, and surely they know about it -- so I would guess either it's not a trademark violation or they don't care. - Source: Hacker News / 22 days ago
Anything that suggests curl into bash just plain sketches me out. Git clone llama.cpp and build it, it's not hard. https://github.com/ggml-org/llama.cpp/blob/master/docs/build.md literally just a few steps for the basics: git clone https://github.com/ggml-org/llama.cpp cmake -B build cmake --build build --config Release. - Source: Hacker News / 22 days ago
I was a bit suspicious of the url but it is also listed on llama.cpp github https://github.com/ggml-org/llama.cpp. - Source: Hacker News / 22 days ago
TurboFieldfare proves the idea beautifully, but it is a bespoke runtime: two supported models, Apple platforms only, custom kernels for everything. I wanted the same idea for the other cheap 8 GB machine on my desk, a Jetson Orin Nano, and I wanted it for any MoE model I could quantize. So instead of porting the runtime, I grafted the idea into llama.cpp, which already runs on the Jetson and already has... - Source: dev.to / about 1 month ago
Llama.cpp is a flexible runtime for GGUF models across CPU, CUDA, Metal, and other backends. - Source: dev.to / about 1 month ago
Fireworks AI - Use state-of-the-art, open-source LLMs and image models at blazing fast speed, or fine-tune and deploy your own at no additional cost with Fireworks AI!
LM Studio - Discover, download, and run local LLMs
Unsloth - Finetune LLMs 2x Faster, 80% Less Memory
Ollama - The easiest way to run large language models locally
SMOL-GPT - Contribute to Om-Alve/smolGPT development by creating an account on GitHub.
Ava PLS - Desktop app for running LLMs locally