For the inference part, you can dockerise your model and use https://banana.dev for serverless GPU. They have examples on github on how to deploy and I’ve done it last year and was pretty straightforward. - Source: Hacker News / 16 days ago
I want to first check the user's ID and only if the user has an active subscription then the request will be forwarded to my API on banana.dev else the request will be blocked at the middleware itself. Should I use Express JS for the middleware i.e. Authentication and forwarding requests? Is there any other better way to improve my project structure? Currently it looks like:. Source: 6 months ago
Hey! Would love to have you try https://banana.dev (bias: I'm one of the founders). We run A100s for you and scale 0->1->n->0 on demand, so you only pay for what you use. I'm at erik@banana.dev if you want any help with it :). - Source: Hacker News / about 1 year ago
CAN you do this in AWS? Of course, do they have a service that does exactly what this banana.dev does? Probably not. Source: about 1 year ago
I've been using banana.dev for easily running my ML models on GPU in a serverless manner, and interacting with them as an API. Although the principle of the service is sound, it is currently too buggy to take into production (very long cold boots, errorring requests, always hitting capacity). Source: about 1 year ago
Shoutout to https://banana.dev , couldn't have made this demo without their hosting. - Source: Hacker News / about 1 year ago
You could try serverless in banana.dev Https://www.banana.dev/blog/how-to-deploy-flan-t5-to-production-serverless-gpu. Source: over 1 year ago
I think there's https://brev.dev and https://banana.dev. - Source: Hacker News / over 1 year ago
Our company is evaluating platforms (banana.dev, slai.io, replicate, pipeline.dev) for our inference models, it would be very helpful if we could get some feedback on the same. If anyone has used these platforms, would love to hear about your experience. Source: over 1 year ago
I'm testing banana.dev now. Will see how well it works. Source: over 1 year ago
I can't find a "cheap" GPU hosting platform. AWS etc. Are all > 200$ per month and they have no serverless option (only found banana.dev which seems to have relatively limited flexibility). Source: over 1 year ago
Own GPU < vast.ai < banana.dev < GCP/AWS and others. Source: over 1 year ago
I call a serverless GPU service (banana.dev) to generate the image and save it to cloud storage. I was using my own VPS with GPU, but the costs were too big for now. Source: over 1 year ago
Do you know an article comparing Banana.dev to other products?
Suggest a link to a post with product alternatives.
This is an informative page about Banana.dev. You can review and discuss the product here. The primary details have not been verified within the last quarter, and they might be outdated. If you think we are missing something, please use the means on this page to comment or suggest changes. All reviews and comments are highly encouranged and appreciated as they help everyone in the community to make an informed choice. Please always be kind and objective when evaluating a product and sharing your opinion.