Developer gateways - MegaLLM, Portkey, LiteLLM, OpenRouter. The pitch is reliability, failover, cost, analytics. They are headless: you get an API, you bring your own interface. Great for shipping code, nothing to actually use without building a client first. - Source: dev.to / 29 days ago

Portkey is a managed gateway and production control plane supporting 1,600+ LLMs with enterprise-grade governance (RBAC, SSO, granular budgets), compliance certifications (SOC2, ISO 27001, GDPR, HIPAA), and deployment options (SaaS, hybrid, or air-gapped). Designed for teams with strict security and audit requirements. See portkey.ai. - Source: dev.to / about 2 months ago

For many teams, especially those starting out or with simpler needs, commercial solutions like Portkey, Helicone, OpenPipe, or LiteLLM Proxy offer off-the-shelf capabilities that cover many common proxy use cases (caching, logging, cost tracking). NeuroLink itself can be seen as an SDK that complements these, allowing you to integrate with them or build similar features on top. - Source: dev.to / 3 months ago

Every engineering team faces the build vs. Buy decision. Today I want to share how replacing our custom LLM manager with Portkey's gateway removed over 11,000 lines of code from our observability platform while actually improving functionality. - Source: dev.to / 10 months ago

Portkey — Focuses on prompt management and optimization with A/B testing capabilities. - Source: dev.to / over 1 year ago

The web service supports generating embeddings from OpenAI and Ollama AI models. It also provides a fallback for users without access to AI models running on a remote server through PostgresML. - Source: dev.to / over 1 year ago

That's outside of the database, though. This is more like what I had in mind -- I just found it: https://postgresml.org/. - Source: Hacker News / about 2 years ago

Some excellent tools were created to represent these tasks "naturally" in SQL and even let most of the computation happen inside the database. PostgresML is a great example. It's built above PostgreSQL and provides a set of functions that allow you to train and use machine learning models with SQL. Here's how you can train a classification model for the classic handwritten digit recognition problem:. - Source: dev.to / over 2 years ago

PostgresML | You know Postgres. Now you know machine learning – PostgresML. - Source: dev.to / over 2 years ago

You can swap in almost any open-source model on Huggingface. HuggingFaceH4/zephyr-7b-beta, Gryphe/MythoMax-L2-13b, teknium/OpenHermes-2.5-Mistral-7B and more.If you haven't seen us here before, we're PostgresML, an open-source MLOps platform built on Postgres. We bring ML to the database rather than the other way around. Source: over 2 years ago