
Evidently AI
Langfuse
LangSmith
Openlayer
Helicone AI
Deepchecks Monitoring
Comet.com
LangChain
8loop
Bolna
Evidently AINo features have been listed yet.
Based on our record, Evidently AI seems to be more popular. It has been mentiond 2 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
It is doable. However the main focus of MLFlow is in experiment tracking. I would suggest for you to look into another monitoring tools such evidentlyai . You can track more things than performance (e.g.data drift). Which may be helpful in a production setting. Source: about 4 years ago
Evidently is an open-source Python library that analyzes and monitors machine learning models. It generates interactive reports based on Panda DataFrames and CSV files for troubleshooting models and checking data integrity. These reports show model health, data drift, target drift, data integrity, feature analysis, and performance by segment. - Source: dev.to / over 4 years ago
Langfuse - Langfuse is an open-source LLM engineering platform that helps teams collaboratively debug, analyze, and iterate on their LLM applications.
Bolna - An open-source platform to build human-like voice AI agents
LangSmith - Build and deploy LLM applications with confidence
Openlayer - Test, fix, and improve your ML models
Helicone AI - Open-source LLM Observability for Developers
Deepchecks Monitoring - Open Source Monitoring for AI & ML