Using the Burr UI to monitor is not the only way. You can integrate your own by leveraging lifecycle hooks, enabling you to log data in a custom format to, say, datadog, langsmith, or langfuse. - Source: dev.to / about 1 month ago

Langfuse (YC W23) | https://langfuse.com | Full-Time | Berlin, Germany | on-site | LLM Observability and Analytics Langfuse is open source [1] observability and analytics tool for LLM applications — think Amplitude and Datadog for LLM apps. Our users use Langfuse to understand what happens in production and use our insights to improve their applications. We have built a number of... - Source: Hacker News / 7 months ago

Langfuse makes tracing and analyzing LLM applications accessible. It is an open-source project under MIT license. - Source: dev.to / 9 months ago

Similar to https://faraday.dev/ that also runs locally. I wish I can install on desktop like Faraday to try it. - Source: Hacker News / 2 months ago

Sadly I can't try this because I'm on Windows or Linux. Was testing apps like this if anyone is interested: Best / Easy to use: - https://lmstudio.ai - https://msty.app - https://jan.ai More complex / Unpolished UI: - https://gpt4all.io - https://pinokio.computer - https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generative-ai/ - https://github.com/LostRuins/koboldcpp (Ai Characters) No UI / Command line (not... - Source: Hacker News / 3 months ago

Aside from LM Studio there's also Faraday https://faraday.dev/. - Source: Hacker News / 6 months ago

I'm having a lot of fun chatting with characters using Faraday and koboldcpp. Faraday has a great UI that lets you adjust character profiles, generate alternative model responses, undo, or edit dialogue, and experiment with how models react to your input. There's also SillyTavern that I have yet to try out. - https://faraday.dev/. - Source: Hacker News / 7 months ago

This is the easiest to setup: https://faraday.dev/ I think Wizard is the “meta” for technical questions now. - Source: Hacker News / 7 months ago