LakeFS
DVC
Monte Carlo Data
Git Large File Storage
ArtiVC
Tonic AI
AWS Lake Formation
Dagster
DataFleets
The world's first cloud platform for unified and privacy-preserving enterprise data analytics powered by Federated Learning. It's never been easier to securely bridge data silos and create new data-driven products with strong network effects. DataFleets allows data teams to ship their analytics out to data, wherever it resides, analyzing it compliantly (e.g., GDPR, CCPA) with game-changing results: 10x available data and 10x speed in accessing it.
Based on our record, LakeFS seems to be more popular. It has been mentiond 6 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
I would add https://github.com/gaul/s3proxy to your list. - Source: Hacker News / over 2 years ago
* data state - this is contents of both your data and metadata at a given point in time. if your data doesn't fit into a single database, this can be difficult to manage. We use this technology to help us: https://lakefs.io/. - Source: Hacker News / about 3 years ago
Saltcured, find these comments super insightful! > Yeah, there's a lot of hidden magic/assumptions in having a "writable snapshot of a specific version" of production data. That's absolutely a huge assumption. This technology has been a game changer for us: https://lakefs.io/ > It becomes a headache when there is too much contention to use these sandboxes, or too much manual effort to reset them to a desired... - Source: Hacker News / about 3 years ago
You should not store your data in git itself, but rather use git to version your data sets. The currently best option for that is (IMHO) https://lakefs.io though there are a few others in various states of usability/maturity. Source: over 3 years ago
I mean if you're ready to adopt a new framework into your ecosystem this is one of the major usecases for LakeFS. Source: over 3 years ago
DVC - Diablo Valley College consists of two campuses serving more than 22,000 students in Contra Costa County each semester with a wide variety of program options.
Monte Carlo Data - Monte Carloโs Data Observability platform increases trust in data by eliminating data downtime, so engineers innovate more and fix less.
Git Large File Storage - Git Large File Storage (LFS) replaces large files such as audio samples, videos, datasets, and graphics with text pointers.
ArtiVC - ArtiVC (Artifact Version Control) is a version control system for large files.
Tonic AI - The fake data company
AWS Lake Formation - AWS Lake Formation is a service that lets you build, secure, and manage your data lake on AWS, reducing the set up time from months to days.
