Helicone AI
Langfuse
LangSmith
Portkey
liteLLM
OpenRouter
LangChain
Openlayer
Codeable
Toptal
Upwork
Lemon.io
Unicorn Dev
Fiverr
Cloud Devs
Andela
Helicone AI
CodeableNo features have been listed yet.
No Helicone AI videos yet. You could help us improve this page by suggesting one.
Helicone AI might be a bit more popular than Codeable. We know about 5 links to it since March 2021 and only 4 links to Codeable. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
Helicone takes the simplest possible approach to LLM monitoring: it's a proxy. Change your OpenAI base URL from api.openai.com to oai.helicone.ai, add your Helicone API key as a header, and every LLM request is logged โ latency, tokens, cost, prompts, and completions. No SDK integration, no code changes beyond a URL swap. - Source: dev.to / 22 days ago
You're monitoring production traffic. You need Langfuse / Phoenix / Helicone / Braintrust for that. Online eval is a different problem class: implicit feedback, drift detection, hallucination rates on your data, not on HellaSwag. - Source: dev.to / about 1 month ago
For many teams, especially those starting out or with simpler needs, commercial solutions like Portkey, Helicone, OpenPipe, or LiteLLM Proxy offer off-the-shelf capabilities that cover many common proxy use cases (caching, logging, cost tracking). NeuroLink itself can be seen as an SDK that complements these, allowing you to integrate with them or build similar features on top. - Source: dev.to / 3 months ago
TL;DR: Go with Langfuse if you want open-source and self-hosted. Pick Helicone if you want the fastest setup (2 minutes, no SDK). Stick with LangSmith if your stack already runs on LangChain. And if your org already pays for Datadog, their LLM module slots right in. - Source: dev.to / 4 months ago
Hey HN, we're Justin and Cole, the founders of Helicone (https://helicone.ai) or self-deploy with our new fully open-source helm chart (https://helicone.ai/selfhost). Yet even with detailed traces, probabilistic systems are notoriously hard to debug at scale. So, we released evaluators (either via LLM-as-judge or custom Python evaluators leveraging the CodeSandbox SDK - https://codesandbox.io/docs/sdk/sandboxes).... - Source: Hacker News / over 1 year ago
I tried signing up to codeable.io recently only to learn that they have temporarily disabled developer applications. Source: over 3 years ago
You can check out https://codeable.io/. Source: over 3 years ago
Yeah, but the freelanchers I got suggested by codeable.io had a fee of over 1000 dollar. I'm just a student and it's for a small recreative project I'm working on as an interest and a challenge. So I'm trying to do it with just the help of the internet. Source: over 4 years ago
That said, one resource I've found to be very helpful is codeable. They vet the developers for you. It's worked great for the type of business I run, where I need people for certain parts of projects, but I'm not a big enough company to actually hire full-time roles. Also, they act as an intermediary for payment- you pay the agreed-upon cost of the work up front, but that money first goes to codeable and payment... Source: over 5 years ago
Langfuse - Langfuse is an open-source LLM engineering platform that helps teams collaboratively debug, analyze, and iterate on their LLM applications.
Toptal - Hire the Top 3% of Freelance Talentยฎ. Toptal is an exclusive network of the top freelance software developers, designers, finance experts, product managers, and project managers in the world.
LangSmith - Build and deploy LLM applications with confidence
Upwork - Forget the old rules. You can have the best people. Right now. Right here.
Portkey - Build production-grade & reliable AI apps with Portkey
Lemon.io - Lemon.io is a community of vetted offshore developers for startups.