Databricks VS Google Cloud Dataflow

Databricks Reviews

Google Cloud Dataflow Reviews

Databricks mentions (17)

• dolly-v2-12b

  Dolly-v2-12bis a 12 billion parameter causal language model created by Databricks that is derived from EleutherAI’s Pythia-12b and fine-tuned on a ~15K record instruction corpus generated by Databricks employees and released under a permissive license (CC-BY-SA). Source: about 1 year ago

• Clickstream data analysis with Databricks and Redpanda

  Global organizations need a way to process the massive amounts of data they produce for real-time decision making. They often utilize event-streaming tools like Redpanda with stream-processing tools like Databricks for this purpose. - Source: dev.to / over 1 year ago

• DeWitt Clause, or Can You Benchmark %DATABASE% and Get Away With It

  Databricks, a data lakehouse company founded by the creators of Apache Spark, published a blog post claiming that it set a new data warehousing performance record in 100 TB TPC-DS benchmark. It was also mentioned that Databricks was 2.7x faster and 12x better in terms of price performance compared to Snowflake. - Source: dev.to / almost 2 years ago

• A Quick Start to Databricks on AWS

  Go to Databricks and click the Try Databricks button. Fill in the form and Select AWS as your desired platform afterward. - Source: dev.to / almost 2 years ago

• data science workspace/notebook solution thoughts?

  I am considering Hex, Deepnote, and possibly Databricks. Does anyone have any experience using the first 2 (i have worked with Databricks in the past) and have thoughts they can share? The company isn't doing any fancy data science so far so I mostly want it for deep product analytics which I can turn into reports that are easily shareable across the org. That being said, I do want to get into statistical... Source: about 2 years ago

Google Cloud Dataflow mentions (14)

• How do you implement CDC in your organization

  Imo if you are using the cloud and not doing anything particularly fancy the native tooling is good enough. For AWS that is DMS (for RDBMS) and Kinesis/Lamba (for streams). Google has Data Fusion and Dataflow . Azure hasData Factory if you are unfortunate enough to have to use SQL Server or Azure. Imo the vendored tools and open source tools are more useful when you need to ingest data from SaaS platforms, and... Source: about 1 year ago

• Here’s a playlist of 7 hours of music I use to focus when I’m coding/developing. Post yours as well if you also have one!

  This sub is for Apache Beam and Google Cloud Dataflow as the sidebar suggests. Source: over 1 year ago

• How are view/listen counts rolled up on something like Spotify/YouTube?

  I am pretty sure they are using pub/sub with probably a Dataflow pipeline to process all that data. Source: over 1 year ago

• Best way to export several GCP datasets to AWS?

  You can run a Dataflow job that copies the data directly from BQ into S3, though you'll have to run a job per table. This can be somewhat expensive to do. Source: over 1 year ago

• Why we don’t use Spark

  It was clear we needed something that was built specifically for our big-data SaaS requirements. Dataflow was our first idea, as the service is fully managed, highly scalable, fairly reliable and has a unified model for streaming & batch workloads. Sadly, the cost of this service was quite large. Secondly, at that moment in time, the service only accepted Java implementations, of which we had little knowledge... - Source: dev.to / almost 2 years ago