Metaflow Reviews

Versatile Data Kit Reviews

Metaflow mentions (14)

• 20 Open Source Tools I Recommend to Build, Share, and Run AI Projects

  Metaflow is an open source framework developed at Netflix for building and managing ML, AI, and data science projects. This tool addresses the issue of deploying large data science applications in production by allowing developers to build workflows using their Python API, explore with notebooks, test, and quickly scale out to the cloud. ML experiments and workflows can also be tracked and stored on the platform. - Source: dev.to / 7 months ago

• Recapping the AI, Machine Learning and Computer Meetup — August 15, 2024

  As a data scientist/ML practitioner, how would you feel if you can independently iterate on your data science projects without ever worrying about operational overheads like deployment or containerization? Let’s find out by walking you through a sample project that helps you do so! We’ll combine Python, AWS, Metaflow and BentoML into a template/scaffolding project with sample code to train, serve, and deploy ML... - Source: dev.to / 10 months ago

• What are some open-source ML pipeline managers that are easy to use?

  I would recommend the following: - https://www.mage.ai/ - https://dagster.io/ - https://www.prefect.io/ - https://metaflow.org/ - https://zenml.io/home. Source: about 2 years ago

• Needs advice for choosing tools for my team. We use AWS.

  1) I've been looking into [Metaflow](https://metaflow.org/), which connects nicely to AWS, does a lot of heavy lifting for you, including scheduling. Source: about 2 years ago

• Selfhosted chatGPT with local contente

  Even for people who don't have an ML background there's now a lot of very fully-featured model deployment environments that allow self-hosting (kubeflow has a good self-hosting option, as do mlflow and metaflow), handle most of the complicated stuff involved in just deploying an individual model, and work pretty well off the shelf. Source: over 2 years ago

Versatile Data Kit mentions (10)

• If dbt is the "T" part of an "ELT", what do you use for "EL"?

  I work at VMware and we use one tool for the whole ELT, it was made internally as there was no good alternative at the time and now we opensourced it, here it is: https://github.com/vmware/versatile-data-kit. Source: over 2 years ago

• Dear, pipeline builders! Which step in your role is the most time consuming?

  "suggestions on how to reduce the time spent on initially generating and adjusting the code" is using some tools that automate ELT. Here's one open-source tool I'm working on with my team: https://github.com/vmware/versatile-data-kit. Source: over 2 years ago

• ETL question (noob)

  Have you heard about versatile data kit (https://github.com/vmware/versatile-data-kit)? I think it meets your needs perfectly:. Source: over 2 years ago

• DE Open Source

  Versatile Data Kit is a framework to bBuild, run and manage your data pipelines with Python or SQL on any cloud https://github.com/vmware/versatile-data-kit Here's a list of good first issues: https://github.com/vmware/versatile-data-kit/issues?q=is%3Aissue+is%3Aopen+label%3A%22good+first+issue%22 Join our slack channel to connect with our team: https://cloud-native.slack.com/archives/C033PSLKCPR. Source: over 2 years ago

• How much python is enough for a beginner?

  There are some DE tools now that provide automation, so you don't need to have advanced Python to build your pipelines, like this one here: https://github.com/vmware/versatile-data-kit. Source: over 2 years ago