Gcsfuse: A user-space file system for interacting with Google Cloud Storage

1

Rclone

#Cloud Storage #Web Service Automation #File Sharing And Backup 616 social mentions

2

Mountpoint for Amazon S3

Mountpoint-s3 is AWS’ first party solution for mounting s3 buckets as file systems: <a href="https://github.com/awslabs/mountpoint-s3">https://github.com/awslabs/mountpoint-s3</a> Haven’t used it but it looks cool, if a bit immature.

#Dev Ops #Build, Test, Deploy #AWS Tools 2 social mentions

3

Google Cloud Filestore

Hi, Brandon from GCS here! If you're looking for all of the guarantees of a real, POSIX filesystem, you want to do fast top level directory listing for 100MM+ nested files, and POSIX permissions/owner/group and other file metadata are important to you, Gcsfuse is probably not what you're after. You might want something more like Filestore: https://cloud.google.com/filestore Gcsfuse is a great way to mount Cloud Storage buckets and view them like they're in a filesystem, but Cloud Storage itself is a flat namespace with no built-in directory support. Listing the few top level directories of a bucket with 100MM files more or less requires scanning over your entire list of objects, which means it's not going to be very fast (listing objects in a leaf directory will be much faster, though). The good news is that listing is consistent. Once Cloud Storage has ack'd your write, your object will be present in any subsequent list calls.

#Work Collaboration #Project Management #Cloud Storage 4 social mentions

4

ObjectiveFS

For workloads with many small files, it usually is better to store many files in a single object. Filesystems with regular POSIX semantics, such as atomic directory renames etc, also makes it easier to integrate with existing software. We have seen a lot of scientific computing usage of our filesystem (https://objectivefs.com) and as you mentioned localized caching of the working set is key to great performance.

#Monitoring Tools #IT Management #VPS 3 social mentions