PromptLayer
Langfuse
Helicone AI
PromptHub
LangSmith
AI Prompt Finder
AI Prompt Generator
Promptaa
Braintrust.dev
Langfuse
Helicone AI
LangSmith
Future AGI
Galileo AI
LangChain
Humanloop
PromptLayer
Braintrust.devNo Braintrust.dev videos yet. You could help us improve this page by suggesting one.
Based on our record, Braintrust.dev should be more popular than PromptLayer. It has been mentiond 3 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
Looks nice, and it's nice that it also supports function call simulation. I've been collecting a list of tools for prompt engineering, I've added Knit now. Newly added: https://promptknit.com/ Newly added: https://github.com/promptfoo/promptfoo https://promptable.ai/ https://github.com/ianarawjo/ChainForge https://promptknit.com/ https://promptrefine.com/ https://www.vellum.ai/ https://www.everyprompt.com/... - Source: Hacker News / about 3 years ago
Braintrust focuses on evaluation-driven development: the idea that monitoring LLM applications means continuously scoring outputs against quality criteria, not just tracking latency and error rates. It's an eval platform first, with observability features built on top of the evaluation infrastructure. - Source: dev.to / 2 months ago
You're monitoring production traffic. You need Langfuse / Phoenix / Helicone / Braintrust for that. Online eval is a different problem class: implicit feedback, drift detection, hallucination rates on your data, not on HellaSwag. - Source: dev.to / 2 months ago
Same approach works with Langfuse, Phoenix, Braintrust, or your existing OTel pipeline โ the metadata.userId pattern is the universal part. - Source: dev.to / 3 months ago
Langfuse - Langfuse is an open-source LLM engineering platform that helps teams collaboratively debug, analyze, and iterate on their LLM applications.
Helicone AI - Open-source LLM Observability for Developers
PromptHub - Test, deploy, and manage your prompts with PromptHub, a prompt management tool designed to be usable by your whole team, not just engineers.
LangSmith - Build and deploy LLM applications with confidence
Future AGI - Open-source engineering stack for self-improving AI Agents
AI Prompt Finder - Prompt finder application