LakeFS VS Seaweed FS

LakeFS Reviews

Seaweed FS Reviews

LakeFS mentions (6)

• Ask HN: AWS S3, Cloudflare R2, GCS, Wasabi, or B2?

  I would add https://github.com/gaul/s3proxy to your list. - Source: Hacker News / about 1 month ago

• Dev / Stage / Prod is the wrong pattern for data pipelines

  * data state - this is contents of both your data and metadata at a given point in time. if your data doesn't fit into a single database, this can be difficult to manage. We use this technology to help us: https://lakefs.io/. - Source: Hacker News / 9 months ago

• Dev / Stage / Prod is the wrong pattern for data pipelines

  Saltcured, find these comments super insightful! > Yeah, there's a lot of hidden magic/assumptions in having a "writable snapshot of a specific version" of production data. That's absolutely a huge assumption. This technology has been a game changer for us: https://lakefs.io/ > It becomes a headache when there is too much contention to use these sandboxes, or too much manual effort to reset them to a desired... - Source: Hacker News / 9 months ago

• Using git to version control experimental data (not code)?

  You should not store your data in git itself, but rather use git to version your data sets. The currently best option for that is (IMHO) https://lakefs.io though there are a few others in various states of usability/maturity. Source: about 1 year ago

• How are you incrementally testing your data pipelines as you develop them?

  I mean if you're ready to adopt a new framework into your ecosystem this is one of the major usecases for LakeFS. Source: over 1 year ago

Seaweed FS mentions (36)

• Ask HN: What distributed file system would you use in 2024?

  What distributed file system would you use for a greenfield homelab project today? Requirements / desires: * Reliable * Performant * Easy to setup and operate Some options: SeaweedFS - https://github.com/seaweedfs/seaweedfs 289 hits: https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=seaweedfs&sort=byPopularity&type=all JuiceFS - https://github.com/juicedata/juicefs 2047 hits:... - Source: Hacker News / 5 days ago

• Show HN: OpenSign – The open source alternative to DocuSign

  > Theoretically they could swap with minio but last time we used it it was not a drop-in replacement yet. Depends on whether AGPL v3 works for you or not (or whether you decide to pay them), I guess: https://min.io/pricing I've actually been looking for more open alternatives, but haven't found much. Zenko CloudServer seemed to be somewhat promising, but doesn't seem to be managed very actively:... - Source: Hacker News / 7 months ago

• The Tailscale Universal Docker Mod

  Wireguard + GUI: https://github.com/wg-easy/wg-easy Backups of mail accounts: https://www.offlineimap.org Cloud storage for phones: http://nextcloud.com Mirroring podcasts locally: https://github.com/akhilrex/podgrab My own matrix instance: https://matrix-org.github.io/dendrite/ Backups: https://restic.net Media Management: https://jellyfin.org Relay only tor help: https://www.torproject.org S3 compatible storage:... - Source: Hacker News / 7 months ago

• Google Cloud Storage FUSE

  JuiceFS is mostly POSIX compatible, but there are important caveats to that like no ACL, copying files changes their mtime (which impacts backup tools), has "close-to-open" consistency (which makes it dangerous for log appenders). Choosing an appropriate solution in this space still depends on what you need to do with the storage, and some options are MooseFS https://github.com/moosefs/moosefs, Curve... - Source: Hacker News / about 1 year ago

• My Experience Self Hosting

  Supabase-Storage uses an S3 compatible API and is ultimately just middleware for it. So, the redundancy would be at the storage backend systems. Seems like the majority of s3 compatible selfhosted systems are built for redundancy/high-availability. With only a brief read of docs, and in no particular order: Https://garagehq.deuxfleurs.fr/documentation/quick-start/ Https://github.com/seaweedfs/seaweedfs CEPH... Source: about 1 year ago