Helicone takes the simplest possible approach to LLM monitoring: it's a proxy. Change your OpenAI base URL from api.openai.com to oai.helicone.ai, add your Helicone API key as a header, and every LLM request is logged — latency, tokens, cost, prompts, and completions. No SDK integration, no code changes beyond a URL swap. - Source: dev.to / about 1 month ago

You're monitoring production traffic. You need Langfuse / Phoenix / Helicone / Braintrust for that. Online eval is a different problem class: implicit feedback, drift detection, hallucination rates on your data, not on HellaSwag. - Source: dev.to / about 1 month ago

For many teams, especially those starting out or with simpler needs, commercial solutions like Portkey, Helicone, OpenPipe, or LiteLLM Proxy offer off-the-shelf capabilities that cover many common proxy use cases (caching, logging, cost tracking). NeuroLink itself can be seen as an SDK that complements these, allowing you to integrate with them or build similar features on top. - Source: dev.to / 3 months ago

TL;DR: Go with Langfuse if you want open-source and self-hosted. Pick Helicone if you want the fastest setup (2 minutes, no SDK). Stick with LangSmith if your stack already runs on LangChain. And if your org already pays for Datadog, their LLM module slots right in. - Source: dev.to / 4 months ago

Hey HN, we're Justin and Cole, the founders of Helicone (https://helicone.ai) or self-deploy with our new fully open-source helm chart (https://helicone.ai/selfhost). Yet even with detailed traces, probabilistic systems are notoriously hard to debug at scale. So, we released evaluators (either via LLM-as-judge or custom Python evaluators leveraging the CodeSandbox SDK - https://codesandbox.io/docs/sdk/sandboxes).... - Source: Hacker News / over 1 year ago

Been working on https://searchcode.com/ again which I bought back, albeit as code search tool for LLMs. It solves the “should I use this library” by allowing the LLM to inspect search and analyse it before integration. Can use it to compare multiple repositories before downloading. It comes with a large amount of token savings and can be really useful when wanting to learn about a codebase. Since it does it anyway... - Source: Hacker News / 2 months ago

I reimagined https://searchcode.com/ since I realised LLMs have issues when it comes to understanding code you want to integrate. It’s useful for looking though any codebase, or multiple without having to clone it. I use it when I have candidate libraries to solve a problem, or I just want to find out how things work. Most recently I pointed it at fzf and was able to pull the insensitive SIMD matching it uses and... - Source: Hacker News / 3 months ago

Searchcode doesn't seem to work for me. All queries (even the ones recommended by the site) unfortunately return zero results. Maybe it got hugged? https://searchcode.com/?q=re.compile+lang%3Apython. - Source: Hacker News / over 1 year ago

Without saying what repos they prioritize, it's hard to take them seriously since some pretty simple searches were "uh-huh" e.g. https://searchcode.com/?q=kubelet&src=2&lan=55 versus https://codesearch.debian.net/search?q=kubelet&literal=1 or the gold standard (although regrettably no longer open source) https://sourcegraph.com/search?q=context:global+kubelet&patternType=keyword&sm=0. - Source: Hacker News / over 2 years ago

Searchcode.com — Comprehensive text-based code search, free for Open Source. - Source: dev.to / over 2 years ago