Langfuse is an open-source LLM engineering platform designed to empower developers by providing insights into user interactions with their LLM applications. We offer tools that help developers understand usage patterns, diagnose issues, and improve application performance based on real user data. By integrating seamlessly into existing workflows, Langfuse streamlines the process of monitoring, debugging, and optimizing LLM applications. Our platform's robust documentation and active community support make it easy for developers to leverage Langfuse for enhancing their LLM projects efficiently. Whether you're troubleshooting interactions or iterating on new features, Langfuse is committed to simplifying your LLM development journey.
Faraday.dev might be a bit more popular than Langfuse. We know about 11 links to it since March 2021 and only 10 links to Langfuse. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
Langfuse is another open-source platform for debugging, analyzing, and iterating on language model applications. It offers tracing, evaluation, and prompt management. While Langfuse offers many capabilities, some (like the Prompt Playground and automated evaluation) are only available in the paid tier for self-hosted users. - Source: dev.to / 22 days ago
It is reportedly used on websites like Langfuse and Million.dev. - Source: dev.to / 2 months ago
LangFuse is a monitoring and debugging platform for LLM-powered applications. It provides insights into token usage and costs. It can also analyze latency, and the performance of AI interactions. The platform allows debug prompts, and analyzes how they behave in production. - Source: dev.to / 3 months ago
You'll notice there's a lot of prompts in these examples. As you develop your prompts, you'll likely want to iterate and refine them over time. I recommend using tools like Langfuse or Langsmith for prompt management and metrics, making it easier to track performance and make improvements. - Source: dev.to / 4 months ago
Langfuse (https://langfuse.com). We started with observability and have branched out into more workflows over time (evals, prompt mgmt, playground, testing...). We have a bunch of traction and are looking for our fourth to sixth hire in scaling and building feature depth. We're hiring in person (4-5 days/week) in Berlin, Germany (salary ranges for each job 70k-130k, up to 0.35% equity). We value quality in... - Source: Hacker News / 4 months ago
Similar to https://faraday.dev/ that also runs locally. I wish I can install on desktop like Faraday to try it. - Source: Hacker News / about 1 year ago
Sadly I can't try this because I'm on Windows or Linux. Was testing apps like this if anyone is interested: Best / Easy to use: - https://lmstudio.ai - https://msty.app - https://jan.ai More complex / Unpolished UI: - https://gpt4all.io - https://pinokio.computer - https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generative-ai/ - https://github.com/LostRuins/koboldcpp (Ai Characters) No UI / Command line (not... - Source: Hacker News / about 1 year ago
Aside from LM Studio there's also Faraday https://faraday.dev/. - Source: Hacker News / over 1 year ago
I'm having a lot of fun chatting with characters using Faraday and koboldcpp. Faraday has a great UI that lets you adjust character profiles, generate alternative model responses, undo, or edit dialogue, and experiment with how models react to your input. There's also SillyTavern that I have yet to try out. - https://faraday.dev/. - Source: Hacker News / over 1 year ago
This is the easiest to setup: https://faraday.dev/ I think Wizard is the “meta” for technical questions now. - Source: Hacker News / over 1 year ago
LangSmith - Build and deploy LLM applications with confidence
BenchLLM by V7 - Test-Driven Development for LLMs
Datumo Eval - Discover Datumo Eval, the cutting-edge LLM evaluation platform from Datumo, designed to optimize AI model accuracy, reliability, and performance through advanced evaluation methodologies.
ChatGPT - ChatGPT is a powerful, open-source language model.
Braintrust - Braintrust connects companies with top technical talent to complete strategic projects and drive innovation. Our AI Recruiter can 100x your recruiting power.
Shell2 by Raiden AI - Code Interpreter with API, Internet, Multiplayer, Open LLMs