
Portkey
Helicone AI
OpenRouter
liteLLM
LangSmith
Langfuse
APIPark
Eden AI
CloudStack
OpenStack
Amazon EC2
OpenShift
Google Compute Engine
Hostwinds
Docker Compose
AlwaysData
Portkey
CloudStackCloudStack is recommended for enterprises and service providers that need a customizable and scalable cloud solution. It is particularly suitable for those who require support for multiple hypervisors and need to integrate with existing infrastructure components. It is also ideal for organizations preferring open-source solutions with active community support.
Based on our record, Portkey should be more popular than CloudStack. It has been mentiond 10 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
Developer gateways - MegaLLM, Portkey, LiteLLM, OpenRouter. The pitch is reliability, failover, cost, analytics. They are headless: you get an API, you bring your own interface. Great for shipping code, nothing to actually use without building a client first. - Source: dev.to / about 1 month ago
Portkey is a managed gateway and production control plane supporting 1,600+ LLMs with enterprise-grade governance (RBAC, SSO, granular budgets), compliance certifications (SOC2, ISO 27001, GDPR, HIPAA), and deployment options (SaaS, hybrid, or air-gapped). Designed for teams with strict security and audit requirements. See portkey.ai. - Source: dev.to / 2 months ago
For many teams, especially those starting out or with simpler needs, commercial solutions like Portkey, Helicone, OpenPipe, or LiteLLM Proxy offer off-the-shelf capabilities that cover many common proxy use cases (caching, logging, cost tracking). NeuroLink itself can be seen as an SDK that complements these, allowing you to integrate with them or build similar features on top. - Source: dev.to / 4 months ago
Every engineering team faces the build vs. Buy decision. Today I want to share how replacing our custom LLM manager with Portkey's gateway removed over 11,000 lines of code from our observability platform while actually improving functionality. - Source: dev.to / 10 months ago
Portkey โ Focuses on prompt management and optimization with A/B testing capabilities. - Source: dev.to / over 1 year ago
You could look at the Apache Cloudstack project Https://cloudstack.apache.org/index.html. Source: over 4 years ago
Helicone AI - Open-source LLM Observability for Developers
OpenStack - OpenStack software controls large pools of compute, storage, and networking resources throughout a datacenter, managed through a dashboard or via the OpenStack API.
OpenRouter - A router for LLMs and other AI models
Amazon EC2 - Amazon Web Services offers reliable, scalable, and inexpensive cloud computing services. Free to join, pay only for what you use.
liteLLM - One library to standardize all LLM APIs
OpenShift - OpenShift gives you all the tools you need to develop, host and scale your apps in the public or private cloud. Get started today.