LakeFS Reviews

CloudShell Reviews

LakeFS mentions (6)

• Ask HN: AWS S3, Cloudflare R2, GCS, Wasabi, or B2?

  I would add https://github.com/gaul/s3proxy to your list. - Source: Hacker News / over 2 years ago

• Dev / Stage / Prod is the wrong pattern for data pipelines

  * data state - this is contents of both your data and metadata at a given point in time. if your data doesn't fit into a single database, this can be difficult to manage. We use this technology to help us: https://lakefs.io/. - Source: Hacker News / almost 3 years ago

• Dev / Stage / Prod is the wrong pattern for data pipelines

  Saltcured, find these comments super insightful! > Yeah, there's a lot of hidden magic/assumptions in having a "writable snapshot of a specific version" of production data. That's absolutely a huge assumption. This technology has been a game changer for us: https://lakefs.io/ > It becomes a headache when there is too much contention to use these sandboxes, or too much manual effort to reset them to a desired... - Source: Hacker News / almost 3 years ago

• Using git to version control experimental data (not code)?

  You should not store your data in git itself, but rather use git to version your data sets. The currently best option for that is (IMHO) https://lakefs.io though there are a few others in various states of usability/maturity. Source: over 3 years ago

• How are you incrementally testing your data pipelines as you develop them?

  I mean if you're ready to adopt a new framework into your ecosystem this is one of the major usecases for LakeFS. Source: over 3 years ago

CloudShell mentions (13)

• GCP Fundamentals: Cloud Shell API

  The Google Cloud Shell API empowers organizations to automate cloud operations, accelerate software delivery, and improve efficiency. By providing a programmatic interface for managing Cloud Shell environments, the API unlocks new possibilities for developers, SREs, and data teams. Explore the official documentation and try the hands-on lab to experience the benefits of the Cloud Shell API firsthand. ... - Source: dev.to / about 1 year ago

• Intro to the YouTube APIs: searching for videos

  Command-line (gcloud) -- Those who prefer working in a terminal can enable APIs with a single command in the Cloud Shell or locally on your computer if you installed the Cloud SDK which includes the gcloud command-line tool (CLI) and initialized its use. If this is you, issue this command to enable the API: gcloud services enable youtube.googleapis.com Confirm all the APIs you've enabled with this command:... - Source: dev.to / almost 2 years ago

• Explore the world with Google Maps APIs

  Gcloud/command-line - Finally, for those more inclined to using the command-line, you can enable APIs with a single command in the Cloud Shell or locally on your computer if you installed the Cloud SDK (which includes the gcloud command-line tool [CLI]) and initialized its use. If this is you, issue the following command to enable all three APIs: gcloud services enable geocoding-backend.googleapis.com... - Source: dev.to / about 2 years ago

• Getting started with the Google Cloud CLI interactive shell for serverless developers

  While you might find that using the Google Cloud online console or Cloud Shell environment meets your occasional needs, for maximum developer efficiency you will want to install the Google Cloud CLI (gcloud) on your own system where you already have your favorite editor or IDE and git set up. - Source: dev.to / almost 4 years ago

• Cloud desktops aren't as good as you'd think

  Here is the product https://cloud.google.com/shell It has a quick start guide and docs. - Source: Hacker News / almost 4 years ago