Unsloth is primarily a fine-tuning tool — it makes QLoRA training 2-5x faster with 50-70% less VRAM. It does NOT run inference. For inference, use Ollama/llama.cpp/MLX. - Source: dev.to / 3 months ago

LoRA is the breakthrough that democratized fine-tuning: by training only 1% of model weights, it reduces GPU/VRAM needs by 10-100x. QLoRA takes it further — quantizing to 4 bits enables fine-tuning 65B+ parameter models on a single consumer GPU with just 3GB VRAM (Unsloth). - Source: dev.to / 3 months ago

Unsloth AI is designed to optimize large language model fine-tuning on modest hardware. It leverages efficient training algorithms to allow even GPUs with 24GB VRAM, like consumer-grade cards, to fine-tune models such as Llama 3 without massive resource demands or overheating risks. - Source: dev.to / 11 months ago

Lot's of tools for each of those separately (RAG and fine-tuning). We're working on combining them but it's not ready yet. You don't need a big GPU cluster. Fine-tuning is quite accessible via both APIs and local tools. Some suggestions: - getkiln.ai (biased, my tool): let's you try all of the below, and compare/eval the resulting models - API based tuning for closed models: OpenAI, Google Gemini - API based... - Source: Hacker News / about 1 year ago

Install and configure Unsloth in Colab. - Source: dev.to / about 1 year ago

Another M&A tool. Useful for software company sellers who are required to disclose details related to software IP ownership such as what third-party dependencies are used in their software. https://securitybot.dev. - Source: Hacker News / 20 days ago

This week I launched IterOps https://iterops.com, a heat mapping, rage click, dead click, scroll mapping, and simple A/B testing tool. I originally built it to have a better idea of what people are doing on my other micro-saas projects like https://securitybot.dev and https://contributoriq.com. Already finding it so useful that I figured I'd just turn it into a product too. - Source: Hacker News / 4 months ago

I’ve built and launched numerous SaaS products (which have paying customers) which were almost entirely built usibg AI agents including https://securitybot.dev and https://dependencydesk.com. My experience so far has been if you possess both deep domain-specific experience and significant coding experience then these coding LLMs, and most notably Opus 4.5, are the greatest productivity booster in the world. - Source: Hacker News / 6 months ago

Https://securitybot.dev/ SecurityBot.dev is an all-in-one uptime, performance, security, and SEO monitoring tool. I launched it a few months ago and have been iterating on it ever since. Later this week SecurityBot.dev will log its 1 millionth uptime check which is pretty cool to see. It includes the usual uptime monitoring service that you see everywhere else, but also features such as a PageSpeed Insights... - Source: Hacker News / 7 months ago

I am working on SecurityBot https://securitybot.dev a service that combines uptime, performance, SEO, and security monitoring. Among other things it inckudes PageSpeed Insights analysis, a broken link auditor (401, 404, 500, etc), and historical ping/uptime results. I recently shipped an MCP server thst can delivered broken link results to Cursor so they can rapidly be resolved. - Source: Hacker News / 8 months ago