In this project we will build a Python banking assistant agent using Strands Agents and make it observable and continuously evaluated using Langfuse — step by step. - Source: dev.to / 3 days ago

Langfuse is the open-source standard for LLM observability. It traces every LLM interaction — prompts, completions, latency, token usage, cost — and provides the tooling to debug, evaluate, and optimize LLM applications in production. Think of it as "Datadog for LLM calls" with a focus on prompt engineering workflows. - Source: dev.to / 22 days ago

You're monitoring production traffic. You need Langfuse / Phoenix / Helicone / Braintrust for that. Online eval is a different problem class: implicit feedback, drift detection, hallucination rates on your data, not on HellaSwag. - Source: dev.to / about 1 month ago

Gateway or proxy attribution. A reverse proxy in front of the model-provider API records the request, computes the cost, and exposes per-customer breakdowns. Open-source options include Helicone, LiteLLM, Langfuse, and OpenLLMetry. Hosted equivalents serve as the AI cost observability layer for teams that want centralized visibility: LangSmith, Datadog LLM Observability, Arize Phoenix. Adds a network hop.... - Source: dev.to / about 1 month ago

Same approach works with Langfuse, Phoenix, Braintrust, or your existing OTel pipeline — the metadata.userId pattern is the universal part. - Source: dev.to / about 2 months ago

The web service supports generating embeddings from OpenAI and Ollama AI models. It also provides a fallback for users without access to AI models running on a remote server through PostgresML. - Source: dev.to / over 1 year ago

That's outside of the database, though. This is more like what I had in mind -- I just found it: https://postgresml.org/. - Source: Hacker News / about 2 years ago

Some excellent tools were created to represent these tasks "naturally" in SQL and even let most of the computation happen inside the database. PostgresML is a great example. It's built above PostgreSQL and provides a set of functions that allow you to train and use machine learning models with SQL. Here's how you can train a classification model for the classic handwritten digit recognition problem:. - Source: dev.to / over 2 years ago

PostgresML | You know Postgres. Now you know machine learning – PostgresML. - Source: dev.to / over 2 years ago

You can swap in almost any open-source model on Huggingface. HuggingFaceH4/zephyr-7b-beta, Gryphe/MythoMax-L2-13b, teknium/OpenHermes-2.5-Mistral-7B and more.If you haven't seen us here before, we're PostgresML, an open-source MLOps platform built on Postgres. We bring ML to the database rather than the other way around. Source: over 2 years ago