For the inference part, you can dockerise your model and use https://banana.dev for serverless GPU. They have examples on github on how to deploy and I’ve done it last year and was pretty straightforward. - Source: Hacker News / about 1 month ago

I want to first check the user's ID and only if the user has an active subscription then the request will be forwarded to my API on banana.dev else the request will be blocked at the middleware itself. Should I use Express JS for the middleware i.e. Authentication and forwarding requests? Is there any other better way to improve my project structure? Currently it looks like:. Source: 6 months ago

Hey! Would love to have you try https://banana.dev (bias: I'm one of the founders). We run A100s for you and scale 0->1->n->0 on demand, so you only pay for what you use. I'm at erik@banana.dev if you want any help with it :). - Source: Hacker News / about 1 year ago

CAN you do this in AWS? Of course, do they have a service that does exactly what this banana.dev does? Probably not. Source: about 1 year ago

I've been using banana.dev for easily running my ML models on GPU in a serverless manner, and interacting with them as an API. Although the principle of the service is sound, it is currently too buggy to take into production (very long cold boots, errorring requests, always hitting capacity). Source: about 1 year ago

For your reference, Apple's pages for Machine Learning for Developers and for their research. The Apple Neural Engine was custom designed to work better with their proprietary machine learning programs -- and they've been opening up access to developers by extending support / compatibility for TensorFlow and PyTorch. They've also got CoreML, CreateML, and various APIs they are making to allow more use of their... Source: about 1 year ago

We even host annual poster sessions of those PhD intern’s work while at our company, and it’ll give you an idea of the caliber of work. It may not be as great as Nvidia, Stryker, Waymo, or Tesla (which are not part of MAANG but I believe are far more ahead in CV), but it’s worth of considering. Source: about 1 year ago

They have something for ML: https://machinelearning.apple.com. - Source: Hacker News / about 2 years ago

They're more subtle about it, I think. https://machinelearning.apple.com/ Some of the papers are pretty good. I don't disagree with your sentiment in aggregate, though. Source: about 2 years ago

Siri is not where it needs to be because Apple refuses to mine user data to enrich it. They also are very hesitant to allow researchers to publish their breakthroughs which makes recruitment very hard. Although this is changing https://machinelearning.apple.com/. - Source: Hacker News / about 2 years ago