In this project we will build a Python banking assistant agent using Strands Agents and make it observable and continuously evaluated using Langfuse — step by step. - Source: dev.to / 3 days ago

Langfuse is the open-source standard for LLM observability. It traces every LLM interaction — prompts, completions, latency, token usage, cost — and provides the tooling to debug, evaluate, and optimize LLM applications in production. Think of it as "Datadog for LLM calls" with a focus on prompt engineering workflows. - Source: dev.to / 21 days ago

You're monitoring production traffic. You need Langfuse / Phoenix / Helicone / Braintrust for that. Online eval is a different problem class: implicit feedback, drift detection, hallucination rates on your data, not on HellaSwag. - Source: dev.to / about 1 month ago

Gateway or proxy attribution. A reverse proxy in front of the model-provider API records the request, computes the cost, and exposes per-customer breakdowns. Open-source options include Helicone, LiteLLM, Langfuse, and OpenLLMetry. Hosted equivalents serve as the AI cost observability layer for teams that want centralized visibility: LangSmith, Datadog LLM Observability, Arize Phoenix. Adds a network hop.... - Source: dev.to / about 1 month ago

Same approach works with Langfuse, Phoenix, Braintrust, or your existing OTel pipeline — the metadata.userId pattern is the universal part. - Source: dev.to / about 1 month ago

Another M&A tool. Useful for software company sellers who are required to disclose details related to software IP ownership such as what third-party dependencies are used in their software. https://securitybot.dev. - Source: Hacker News / 20 days ago

This week I launched IterOps https://iterops.com, a heat mapping, rage click, dead click, scroll mapping, and simple A/B testing tool. I originally built it to have a better idea of what people are doing on my other micro-saas projects like https://securitybot.dev and https://contributoriq.com. Already finding it so useful that I figured I'd just turn it into a product too. - Source: Hacker News / 4 months ago

I’ve built and launched numerous SaaS products (which have paying customers) which were almost entirely built usibg AI agents including https://securitybot.dev and https://dependencydesk.com. My experience so far has been if you possess both deep domain-specific experience and significant coding experience then these coding LLMs, and most notably Opus 4.5, are the greatest productivity booster in the world. - Source: Hacker News / 6 months ago

Https://securitybot.dev/ SecurityBot.dev is an all-in-one uptime, performance, security, and SEO monitoring tool. I launched it a few months ago and have been iterating on it ever since. Later this week SecurityBot.dev will log its 1 millionth uptime check which is pretty cool to see. It includes the usual uptime monitoring service that you see everywhere else, but also features such as a PageSpeed Insights... - Source: Hacker News / 7 months ago

I am working on SecurityBot https://securitybot.dev a service that combines uptime, performance, SEO, and security monitoring. Among other things it inckudes PageSpeed Insights analysis, a broken link auditor (401, 404, 500, etc), and historical ping/uptime results. I recently shipped an MCP server thst can delivered broken link results to Cursor so they can rapidly be resolved. - Source: Hacker News / 8 months ago