GitHub Reviews

1. Reinhard

   · Boss at CLOUD Meister · over 5 years ago
   perfect 4 open Source

Prodigy Reviews

GitHub mentions (2474)

• I audited a 5.5 GB AI training dataset by downloading 0.8% of it

  Import struct, json, urllib.request REL = "https://github.com/{owner}/{repo}/releases/download/{tag}/" PART = ["...part1.zip.001", "...part2.zip.002", "...part3.zip.003"] SIZE = [1992294400, 1992294400, 1893639808] # from the releases API Def grab(part, start, end, out): # HTTP range fetch req = urllib.request.Request(REL + PART[part], Headers={"Range":... - Source: dev.to / 2 days ago

• Superlogical – Mitchell Hashimoto

  Is published at https://github.com/.keys so an SSH server to which you connect could do a reverse lookup. This is the reason why my ~/.ssh/config has those 2 lines at the end:

          Host *.

  - Source: Hacker News / 9 days ago

• Your Agent's Confidence Score Is Not a Probability

  All of this assumes you can actually inspect what the agent did — the real inputs after resolution, the real tool outputs, the real intermediate steps. That is the other half of the workflow. AgentLens captures the trace: every model and tool step, resolved inputs, raw outputs. agent-eval scores and gates the output; AgentLens gives you the unforgeable, agent-didn't-author trace data for Tier 1+2 to score against... - Source: dev.to / 10 days ago

• Foreman 101: agentic coding as Kubernetes resources

  # git: the API token, plus the credential used for the push Kubectl create secret generic foreman-github \ --from-literal=GITHUB_TOKEN="$GITHUB_TOKEN" -n foreman-system Kubectl create secret generic foreman-git-credentials \ --from-literal=token="$GITHUB_TOKEN" -n foreman-system Helm upgrade foreman llmkube/foreman -n foreman-system --reuse-values \ --set agent.githubToken.secretName=foreman-github \ ... - Source: dev.to / 10 days ago

• Stop Judging Every Run: Eval Sampling Is a Budget Decision, Not a Coverage One

  This is why eval and observability ship as a unit, not as separate purchases. agent-eval scores and gates the output — the tiers above, drift, hallucination. AgentLens captures the trace of how the agent got there: every model step and tool call, the resolved inputs, the raw outputs, the trajectory. Two things fall out of that:. - Source: dev.to / 20 days ago

Prodigy mentions (25)

• Launch HN: Encord (YC W21) – Unit testing for computer vision models

  This is really cool. The annotation-to-testing-to-annotation-etc. Feedback loop makes a ton of sense, and I'd encourage others who may be confused on this post to look at the Automotus case study https://encord.com/customers/automotus-customer-story/ for the annotation side, but my understanding is the relationship between model outputs and annotation steering is out of scope for that project - do you know of... - Source: Hacker News / over 2 years ago

• Against LLM Maximalism

  Spacy [0] is a state-of-art / easy-to-use NLP library from the pre-LLM era. This post is the Spacy founder's thoughts on how to integrate LLMs with the kind of problems that "traditional" NLP is used for right now. It's an advertisement for Prodigy [1], their paid tool for using LLMs to assist data labeling. That said, I think I largely agree with the premise, and it's worth reading the entire post. The steps... - Source: Hacker News / almost 3 years ago

• Remote Work 2.0: The Tools, Trends, and Challenges of the Post-Pandemic Work Era

  Prodigy AI - Offers software engineers career coaching, skill assessment, and job matching. Visit Prodigy AI. - Source: dev.to / almost 3 years ago

• [D] A model to extract relevant information from a Sample Ballot.

  I essentially want to use a Combo of OCR + NER to attempt to identify this, but I'm not sure NER is well suited for this, as it is not natural language, so there is little context to go off of. I was thinking of perhaps using Prodigy, a data annotation tool, to annotate Candidate Names, Races, etc, and perhaps it will be able to learn off of image data alone wheat these fields tend to look like. Source: over 3 years ago

• Sampling leaves from a tree

  I come from a similar application area, where I try to tag (annotation/label) a taxonomy of products iteratively. You are trying something slightly different, AFAIU, labeling a flat set of songs, each song with a set of tags from ontology (directed graph)From an application point of view, this is what taxonomists often do, when migrating products from one catalog to another: mapping one taxonomy to another. There... Source: over 3 years ago