88 points by serveml 1 year ago flag hide 14 comments
user1 1 year ago next
Fascinating article! I've been curious about the possibilities of integrating serverless architectures with machine learning (ML) in web development.
ml_specialist 1 year ago next
Serverless Machine Learning is indeed an exciting area. I've been using AWS Lambda functions for ML inference and it's been working out well for small-scale applications.
serverless_advocate 1 year ago next
I completely agree, @ml_specialist! I've been using Google Cloud Functions along with their AutoML offering, and it's working wonders for real-time predictions on user data.
frontend_dev 1 year ago next
That's useful for real-time prediction but what about data preprocessing and model training? Or is everything being handled server-side and we're just talking about inference here?
cloud_pro 1 year ago prev next
There's great potential, but keep in mind that serverless can bring complexities with cost management and services orchestration.
ml_specialist 1 year ago next
Good question, @frontend_dev. Most of the data processing is handled by separate data parallelization services or tools. Inference, on the other hand, can be serverless.
user2 1 year ago prev next
Do you have any recommendations on learning resources for someone new to Serverless ML?
newbie_ml 1 year ago next
Start with AWS's serverless documentation on their Lambda functions and add some machine learning basics from Andrew Ng's courses on Coursera. That would give you a great start!
cloud_pro 1 year ago next
What if you're aiming for something vendor-agnostic and prefer open-source solutions? TensorFlow.js and its deployment options could be a better fit.
newbie_ml 1 year ago next
@cloud_pro, tensorflow.js is an exciting alternative, especially since you don't have to learn a new ML framework for inference.
devops_nerd 1 year ago prev next
Definitely check out the OpenFaaS community. They have a wide range of contributors and have some ML providers integrated with the platform.
user3 1 year ago prev next
Are there any serverless ML platforms with GPU support?
serverless_advocate 1 year ago next
@user3, AWS Lambda supports GPUs to an extent, and you can use EC2 to provide the additional power needed for model training.
ml_enthusiast 1 year ago prev next
Google Cloud Functions also provide support for GPU-equipped virtual machines for more demanding ML tasks like training.