Vast.ai Reviews and Details

Social recommendations and mentions

• I Built a 500k-Domain Search Engine for Makers in a Weekend for $10

  3. Rent a 4090 with https://vast.ai to run vllm 4. Let llm model invent its own category and tag names freely 5. `code is going up as open source` soon (TM). - Source: Hacker News / about 1 month ago

• Ask HN: Would you rent M3 Ultra from me?

  I (think) that Vast [1] did something vaguely similar a few years back where regular people could rent out their nVidia GPUs. Might be worth looking into if that's an option. [1] - https://vast.ai. - Source: Hacker News / about 2 months ago

• South Korea to spend $1T on more memory chip production and humanoid robots

  > The same logic for why self-driving cars can't be cloud based, applies for robots. Something cannot be in the middle of a delicate operation and then "oops!", no network, it just stops. I don't think you understood my post. The equivalent of self-driving is the movement control I was talking about. Self-driving cars don't have high level logic, except for route planning. Which often is offloaded to the... - Source: Hacker News / 3 months ago

• I Rented Out My GPU for Passive Income — Here's What Happened After My First Week

  A week ago I connected it to Vast.ai — a GPU marketplace where people rent compute time. No code required. You install a daemon, set a price, and wait for someone to rent your machine. - Source: dev.to / 3 months ago

• Three GPU affiliate programs I wired into an AI tool directory

  RunPod is easier to link to than Vast.ai. RunPod's referral URL resolves cleanly with no login wall before the landing page. Vast.ai drops you directly on the instance marketplace, which is great if you already know what you're doing and confusing if you don't. For a cold click from a model page, RunPod's onboarding is softer. - Source: dev.to / 3 months ago

• Show HN: TripoSplat Running in the Browser

  Had some fun with the new TripoSplat from http://vast.ai, it's a nice model! Got it to run in the browser by quantizing a bunch of the weights and chunked SDPA. If you have ideas on how to improve I'd love to hear it! - Source: Hacker News / 3 months ago

• I Deployed Gemma 4 32B on a Rented H100 for $1.50/Hour. The Hard Part Wasn't What I Expected.

  This week I experimented with vast.ai, a marketplace where you can rent GPU hardware on demand for AI workloads. I walked in expecting friction. Provisioning an NVIDIA H100, deploying a brand-new model, configuring networking — all of it sounded like a weekend project at minimum. Instead, I had a freshly released Gemma 4 32B model running and responding to prompts in about an hour. The cost? Roughly $1.50 per hour... - Source: dev.to / 5 months ago

• Nvidia NeMo-Claw: The Game-Changing Framework That's Making LLM Training 10x Faster

  For teams using vast.ai or similar GPU cloud services, the framework's efficient resource utilization means you can achieve the same results with fewer rented GPUs, directly impacting your bottom line. - Source: dev.to / 6 months ago

• Faster, Cheaper, Local: The Myth and Reality of Replacing Claude for Coding

  Vast.ai is a great idea, honestly. They let you rent GPUs cheaply and run any model with pre-built templates. You can spin an instance in minutes. - Source: dev.to / 12 months ago

• AWS pricing for Kiro dev tool dubbed 'a wallet-wrecking tragedy'

  With open-weights models reaching a level where they can sufficiently be used for agentic coding, the price can be directly compared to the price of GPU rentals: https://vast.ai/ has an H100 at $1.65/hr. Which can support ~40 concurrent sessions at 40 tok/s. Depending on your agentic workload, you can stretch that any way you like, but let's say it might support 10 active developers at a speed comparable to Claude... - Source: Hacker News / about 1 year ago

• Launch HN: Exa (YC S21) – The web as a database

  Right, I saw that. ChatGPT does the same. My question is how you can confirm the entity you're referencing in each source is actually the entity you're looking for? An example I ran into recently is Vast (https://www.vastspace.com/). There are a number of other notable startups named Vast (https://vast.ai/, https://www.vastdata.com/). I understand Clay, which your Websets product is clearly inspired by, does a... - Source: Hacker News / over 1 year ago

• Running Your Own LLMs in the Cloud: A Practical Guide

  Vast.ai operates as a marketplace where users can both offer and rent GPU instances. The pricing is generally quite competitive, often lower than RunPod, especially for low-end GPUs with less than 24GB of VRAM. However, it also provides access to more powerful systems, like the 4xA100 setup I used to run Llama3.1-405B. - Source: dev.to / about 2 years ago

• Nvidia pursues $30B custom chip opportunity with new unit

  There are already ways to get around this. For example, renting compute from people who aren't in datacenters. Which is already a thing: https://vast.ai. - Source: Hacker News / over 2 years ago

• A SETI-like project to train LLM on libgen, scihub and the likes?

  By "SETI" I assume you mean the SETI@Home distributed computing project. There's a two-way market where you can rent out your GPU here: https://vast.ai/. - Source: Hacker News / over 2 years ago

• Ask HN: What's the best hardware to run small/medium models locally?

  - https://vast.ai/ (linked by gchadwick above). - Source: Hacker News / almost 3 years ago

• Ask HN: What's the best hardware to run small/medium models locally?

  Have you considered running on a cloud machine instead? You can rent machines on https://vast.ai/ for under $1 an hour that should work for small/medium models (I've mostly been playing with stable diffusion so I don't know what you'd need for an LLM off hand). Good GPUs and Apple hardware is pricey. Get a bit of automation setup with some cloud storage (e.g backblaze B2) and you can have a machine ready to run... - Source: Hacker News / almost 3 years ago

• Budget-friendly Cloud server to host OpenAI Whisper?

  I have heard vast.ai is cheap but I haven't tried it out. https://websiteinvesting.com/reviews/vast-ai-review/. Source: almost 3 years ago

• getting 'fake_useragent' error when trying to load models from civitai browser plus extension

  Hello, I've been having trouble with getting the civitai browser plus extension to retrieve models, this happens on every instance I have tried through vast.ai using the secure cloud gpus, does anyone have any idea as to why this could be? Source: almost 3 years ago

• If you use a cloud GPU service to run SD, which one do you prefer right now?

  I used to prefer vast.ai since I could rent instances for less than on Runpod, but now the prices have hiked so much on verified instances that Runpod is now about as much as interruptible instances, and I get much faster download speeds on it. I have no preference, because OTOH interruptible instances can get taken even when you're in the middle of using the GPU, and un-interruptable ones cost ~25% more. I would... Source: almost 3 years ago

• Virtual machine Unreal Engine 5 image running really slow

  I'm using the virtual machines on here and have installed the UE 5 custom built image and am on my virtual machine but it's extremely sluggish, my local network is fast and I've had zero issues with latency on vast.ai but on Azure it's incredibly slow - have set my region to the same one I live in aswell - have no idea what's making this so incredibly slow? Source: almost 3 years ago

• Need help connecting Oobabooga running on vast.ai with ST

  Hey guys, I need your help what do I enter under Blocking API URL and Streaming API URL while running oobabooga on vast.ai? I tried using the public IP shown on vast.ai with the right port, but it won't connect. Source: about 3 years ago