llama.cpp
LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
Some of the top features or benefits of llama.cpp are: Performance, Portability, Ease of Use, Community Support, and Flexibility. You can visit the info page to learn more.
llama.cpp Alternatives & Competitors
The best llama.cpp alternatives based on verified products, community votes, reviews and other factors.
Latest update:
-
/lm-studio-alternativesDiscover, download, and run local LLMs.
Key LM Studio features:
User-Friendly Interface Customizability Integration Capabilities Scalability
-
/ollama-alternativesThe easiest way to run large language models locally.
Key Ollama features:
User-Friendly UI Customizable Workflows Integration Capabilities Automation Features
-
Try for freeThe desktop AI tool for cybersecurity professionals. Built for pentesters, red teamers, and security engineers โ agentic AI that runs on your machine, works with your tools, and executes real security workflows.
Key Hacker Sidekick features:
AI-Powered Bug Bounty Assistance Time Savings for Security Researchers Beginner-Friendly Centralized Workflow
-
/ava-pls-alternativesDesktop app for running LLMs locally.
-
/hugging-face-alternativesThe AI community building the future. The platform where the machine learning community collaborates on models, datasets, and applications.
Key Hugging Face features:
Model Availability Ease of Use Community and Collaboration Documentation and Tutorials
-
/opencode-alternativesThe AI coding agent, built for the terminal.
-
/podman-alternativesSimple debugging tool for pods and images.
Key Podman features:
Daemonless Architecture Rootless Containers Kubernetes Support Compatibility with Docker CLI
-
/ratatui-alternativesRust library that's all about cooking up terminal user interfaces (TUIs).
Key Ratatui features:
Culinary Diversity User-Friendly Interface Community Engagement Recipe Customization
-
/jan-ai-alternativesRun LLMs like Mistral or Llama2 locally and offline on your computer, or connect to remote AI APIs like OpenAIโs GPT-4 or Groq.
Key Jan.ai features:
User-Friendly Interface Comprehensive Features Personalization Strong Customer Support
-
/flatpak-alternativesFlatpak is the new framework for desktop applications on Linux.
Key Flatpak features:
Cross-distribution support Sandboxing Dependency management Bleeding-edge software
-
/vs-code-alternativesBuild and debug modern web and cloud applications, by Microsoft.
Key VS Code features:
Cross-platform Extensibility Integrated Git Performance
-
/opencode-telegram-bot-alternativesAbout OpenCode mobile client via Telegram.
Key Opencode Telegram Bot features:
Customizability Community Support Cost-Effective Transparency
-
/pipewire-alternativesLow-latency multimedia framework for Linux audio and video, supporting PulseAudio, JACK, ALSA and GStreamer applications.
Key PipeWire features:
Unified Audio and Video Management Low-Latency Performance Compatibility Security Enhancements
-
/neovim-alternativesVim's rebirth for the 21st century.
Key Neovim features:
Extensibility Asynchronous Plugins Modern Codebase Compatibility
llama.cpp discussion
