Google Cloud Dataflow Reviews

GainKnowHow.com Reviews

Google Cloud Dataflow mentions (14)

• How do you implement CDC in your organization

  Imo if you are using the cloud and not doing anything particularly fancy the native tooling is good enough. For AWS that is DMS (for RDBMS) and Kinesis/Lamba (for streams). Google has Data Fusion and Dataflow . Azure hasData Factory if you are unfortunate enough to have to use SQL Server or Azure. Imo the vendored tools and open source tools are more useful when you need to ingest data from SaaS platforms, and... Source: over 2 years ago

• Here’s a playlist of 7 hours of music I use to focus when I’m coding/developing. Post yours as well if you also have one!

  This sub is for Apache Beam and Google Cloud Dataflow as the sidebar suggests. Source: over 2 years ago

• How are view/listen counts rolled up on something like Spotify/YouTube?

  I am pretty sure they are using pub/sub with probably a Dataflow pipeline to process all that data. Source: over 2 years ago

• Best way to export several GCP datasets to AWS?

  You can run a Dataflow job that copies the data directly from BQ into S3, though you'll have to run a job per table. This can be somewhat expensive to do. Source: over 2 years ago

• Why we don’t use Spark

  It was clear we needed something that was built specifically for our big-data SaaS requirements. Dataflow was our first idea, as the service is fully managed, highly scalable, fairly reliable and has a unified model for streaming & batch workloads. Sadly, the cost of this service was quite large. Secondly, at that moment in time, the service only accepted Java implementations, of which we had little knowledge... - Source: dev.to / about 3 years ago

GainKnowHow.com mentions (4)

• Ask HN: Freelancer? Seeking freelancer? (October 2022)

  SEEKING WORK Location: Colorado Mountains Remote: yes Pitch: I've been working on making startup MVPs lately. I've got a pretty good stack right now to get your MVP off the ground quickly. Rails website with a React frontend using a Bootstrap theme and backend services using Golang with Temporal.io. You can see my last two projects https://app.awareops.com/ https://gainknowhow.com/ Contact:... - Source: Hacker News / over 2 years ago

• What do you think of my learning platform?

  I'm working on starting a learning platform called GainKnowHow.com. Basically, you learn topics in the right order to make sure you have the context to learn more advanced skills. I'm working on a MySQL tutorial and I'd love your feedback on the platform. The MySQL content is still a work in progress. You can see the tutorial here https://app.gainknowhow.com/public/graph/ed68268d-f166-4cd7-95db-2258e2c4f9cd What... Source: almost 3 years ago

• One year as a solo dev building open-source data tools without funding

  Fellow solo developer here. Making https://gainknowhow.com/ . It's my take on how to keep everyone on the same page at growing organizations. My basic premise is that the current data structure to store documentation in folders is not ideal. A better data structure to store knowledge in a graph of connected ideas. Storing knowledge in this manner ensures users understand context when learning skills. I'd love your... - Source: Hacker News / almost 3 years ago

• Learn about Concept Maps

  Concept maps are exactly how I want to learn. They are behind the ideas on my startup I'm working on https://gainknowhow.com . Each edge in my software is a requirement. It's interesting that cmap has different edge types that specify how a connection is required. I think all edges should just be hard requirements. - Source: Hacker News / about 3 years ago