Unsloth is primarily a fine-tuning tool — it makes QLoRA training 2-5x faster with 50-70% less VRAM. It does NOT run inference. For inference, use Ollama/llama.cpp/MLX. - Source: dev.to / 4 months ago

LoRA is the breakthrough that democratized fine-tuning: by training only 1% of model weights, it reduces GPU/VRAM needs by 10-100x. QLoRA takes it further — quantizing to 4 bits enables fine-tuning 65B+ parameter models on a single consumer GPU with just 3GB VRAM (Unsloth). - Source: dev.to / 5 months ago

Unsloth AI is designed to optimize large language model fine-tuning on modest hardware. It leverages efficient training algorithms to allow even GPUs with 24GB VRAM, like consumer-grade cards, to fine-tune models such as Llama 3 without massive resource demands or overheating risks. - Source: dev.to / about 1 year ago

Lot's of tools for each of those separately (RAG and fine-tuning). We're working on combining them but it's not ready yet. You don't need a big GPU cluster. Fine-tuning is quite accessible via both APIs and local tools. Some suggestions: - getkiln.ai (biased, my tool): let's you try all of the below, and compare/eval the resulting models - API based tuning for closed models: OpenAI, Google Gemini - API based... - Source: Hacker News / about 1 year ago

Install and configure Unsloth in Colab. - Source: dev.to / over 1 year ago

Every commit has a message. Every PR has a title and description. The status update already exists. It's just locked in GitHub. Who this is for: - Founders updating investors - PMs writing release notes - CEOs who want visibility without standups - Anyone who asks "what shipped?" and waits for an engineer to respond What it does: Connect your repos. Ask questions: - "What shipped this month?" - "Who... - Source: Hacker News / 7 months ago

Gitmore (https://gitmore.io) – natural language queries across GitHub, GitLab, and Bitbucket. Instead of filtering PRs, scanning commit logs, or asking engineers for updates: - "What shipped last week?" - "Who's been working on the API?" - "Which PRs have been open longest?" - "Summarize this month's releases" Plain English in, plain English out. How it works: Connect your repos via OAuth. We register... - Source: Hacker News / 7 months ago

If you're a founder who doesn't code, you probably rely on engineers to tell you what's shipping. That works until investors ask for updates, customers want a changelog, or you just need to know where things stand. What it does: Connect your repos. Ask questions: "What shipped last week?" "What's in progress?" "Who worked on what?" Get plain English answers from your commit history. Automated reports: Schedule... - Source: Hacker News / 7 months ago

Gitmore (https://gitmore.io) One feature I built that's been useful: a Slack bot that queries your Git history. Connect your repos. Add the bot to Slack. Ask:. - Source: Hacker News / 7 months ago

- 2FA support GitHub, GitLab, Bitbucket – one dashboard. Free for 1 repo: https://gitmore.io How do you currently handle investor questions about engineering progress? - Source: Hacker News / 7 months ago