Modal Reviews and details

Social recommendations and mentions

• Ask HN: Those of you who don't use AWS/Azure/GCP, what do you use for hosting?

  I'm going to make a left field suggestion and say Modal Labs if you're mostly Python based: https://modal.com/ It should work with other languages through Docker and their Python API, but I can't speak to the ease of deployment in that case. - Source: Hacker News / 12 days ago

• Ask HN: How does deploying a fine-tuned model work

  I recommend checking out https://modal.com It’s “serverless” and You only pay for the compute you use. - Source: Hacker News / 20 days ago

• I got #1 Product of the Day on Product Hunt without Spending a Dollar

  Apart from Supabase, I use Modal. I consider it the best hosting service for running ML and AI processes in Python. - Source: dev.to / 20 days ago

• Differential: Type safe RPC that feels like local functions

  I'm curious if people's qualms around abstracting the cloud/network also apply to the https://modal.com product. Differential seems like a similar project at its core, just focused on the Typescript + microservices ecosystem. - Source: Hacker News / 2 months ago

• Software Infrastructure 2.0: A Wishlist (2021)

  > The author apparently does not have any experience in building systems/infrastructure. Well, he built https://modal.com , one of the coolest things since sliced mangoes. - Source: Hacker News / 3 months ago

• Unison Cloud

  Yep, that’s right. Modal (https://modal.com) is actually what you’re describing with Python, but Modal is just the compute layer (Unison is going for the whole cloud), and Modal isn’t doing anything to handle version alignment across service boundaries. - Source: Hacker News / 3 months ago

• Ask HN: Where to find an env with GPU for model training?

  I saw this a few weeks ago, haven't tested it yet but it looked cool and not so pricey: https://modal.com/ The three musketeers of cloud also allow you to use GPUs but it may be harder to get, especially GCP that needs human whitelisting of your request to use GPU instances. - Source: Hacker News / 4 months ago

• LLM as a Service API

  My 2c is to look up to modal.com because they can charge extra for their simple Python library. Source: 5 months ago

• Deploy Hugging Face Models on Serverless GPU

  There are a number of serverless GPU providers out there, such as Banana, Replicate, Beam, Modal and many more. - Source: dev.to / 12 months ago

• A Manifesto for Cloud-Oriented Programming from the creator of the CDK

  This looks neat, and it's in the direction that I've predicted cloud to be headed for a while, which is code and infrastructure that's much more intermingled. In a lot of ways it reminds of modal.com, but free and open source and not using bespoke backing infrastructure. That being said, I wish using this didn't require me to learn a whole brand new programming language as that makes adopting it in a professional... Source: 12 months ago

• [D] Tips to accelerate Sagemaker deployment?

  I used to use Sagemaker at Canva.com, and it was slow, but not that slow. Still too slow though, so I left to build https://modal.com/ which can deploy in ~1s. Source: almost 1 year ago

• Serverless voice chat with Vicuna-13B

  That's a pretty cool showcase of modal [1]. From a marketing perspective I have to congratulate, this is a really well done way to get people to check out your platform. 1: https://modal.com/. - Source: Hacker News / about 1 year ago

• The Great MLOps Hoax: Is It Just Data Engineering in Disguise?

  Just use https://modal.com/ :) At Canva I built auto-scaling GPU infra on K8s for model training[1], and it's way too much work and operational expense to be worth building yourself. I went work at Modal because building it properly once and then distributing the solution was going to be just way better and more efficient. 1.... - Source: Hacker News / about 1 year ago

• Where can I host and access WhisperX as an API.

  Modal is a serverless platform, lets you deploy ml models pretty easily (they have a whisper guide in their docs). Source: about 1 year ago

• My View on A.I.

  I changed career path 8 years ago to help build 'strong AI' because I found it so exciting, and I now help build ML infrastructure (modal.com). The pace of the improvements in ML model quality and accesibility since early 2022 has been truly astonishing, and I think isn't appreciated by layman. These AI/ML models are the output of a gargatuan, global computing innovation industry: from the chip design labs in Palo... Source: about 1 year ago

• Is there another free cloud GPU services?

  I'm still stuck on the waitlist, but a friend of mine got an account on Modal. At the moment, they give you free 10 dollars of credits every month that can be used on various deployments, with pricing done per-hour of uptime. They don't even need credit card info for free accounts, which is pretty cool. Source: about 1 year ago

• Programming and training a VERY basic chat bot as a beginner to ML?

  You can use modal.com, LangChain, and the OpenAI API to run a chatbot that's basic but still better than all chat bots that existed 10 years ago. Source: about 1 year ago

• [D] What ML dev tools do you wish you'd discovered earlier?

  Airflow is not a good tool for ML development. Leave Airflow back in 2018. Also Modal can do prod model deployment, model pipelines, and inference. Source: about 1 year ago

• What is the cheapest way to deploy a HuggingFace model?

  It's modal.com imo, but I work for Modal so I'm biased as hell :). Source: over 1 year ago

• Create an email newsletter from an RSS feed with Modal

  The code itself is written to be beginner-friendly and easy to setup, as it in part serves an example of how to build applications on Modal.com. Source: over 1 year ago