Portkey — Focuses on prompt management and optimization with A/B testing capabilities. - Source: dev.to / 3 months ago

Portkey AI Gateway offers an open-source AI Gateway that simplifies managing generative AI workflows. This powerful tool supports working with multiple large language models (LLMs) from various providers, along with different data formats (multimodal).  By acting as a central hub, Portkey streamlines communication and simplifies integration, improving your application's reliability, cost-effectiveness, and accuracy. - Source: dev.to / 7 months ago

The control panel would be Portkey. To avoid managing multiple API keys (Anyscale, Perplexity, and TogetherAI) securely save them to the vault using virtual keys. - Source: dev.to / about 1 year ago

Portkey - Control panel for Gen AI apps featuring an observability suite & an AI gateway. Send & log up to 10,000 requests for free every month. - Source: dev.to / over 1 year ago

Https://portkey.ai/ - is also a nice addition to the list. - Source: Hacker News / over 1 year ago

Humanloop | London and San Francisco | Full time in person | https://humanloop.com Humanloop is building infrastructure for AI application development. We're the LLM Evals Platform for Enterprises. Duolingo, Gusto, and Vanta use Humanloop to evaluate, monitor, and improve their AI systems. ROLES:. - Source: Hacker News / 6 months ago

- https://humanloop.com/) for teaching me the philosophy of implementing a copilot textarea. I wish I could have used the project directly, but integrating just one React component into Rails while keeping importmap and StimulusJS was quite challenging. Given the limited time, I decided to move on with StimulusJS. This is our first time building an open-source project to share with the world, and we’re a bit... - Source: Hacker News / 9 months ago

- Conversational simulation is an emerging idea building on top of model-graded eval” - AI Startup Founder Things to consider when comparing options: “Types of metrics supported (only NLP metrics, model-graded evals, or both), level of customizability; supports component eval (i.e. Single prompts) or pipeline evals (i.e. Testing the entire pipeline, all the way from retrieval to post-processing)” “+method of... - Source: Hacker News / over 1 year ago

Humanloop (YC S20) | London (or remote) | https://humanloop.com We're looking for exceptional engineers that can work at varying levels of the stack (frontend, backend, infra), who are customer obsessed and thoughtful about product (we think you have to be -- our customers are "living in the future" and we're building what's needed). Our stack is primarily Typescript, Python, GPT-3. Please apply at... - Source: Hacker News / about 2 years ago

https://humanloop.com/ Find the prompts users love and fine-tune custom models for higher performance at lower cost. - Source: Hacker News / over 2 years ago