Based on our record, Google Cloud Dataproc should be more popular than Goka. It has been mentiond 3 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
You might want to try: https://github.com/lovoo/goka -- it uses levelDB to keep state from a stream. The application we wrote in-house with goka can process (keeping state) approximately 800+ messages/sec per consumer in a consumer-group. Source: about 3 years ago
I have also a spark cluster created with google cloud dataproc. Source: about 1 year ago
Specifically, we heavily rely on managed services from our cloud provider, Google Cloud Platform (GCP), for hosting our data in managed databases like BigTable and Spanner. For data transformations, we initially heavily relied on DataProc - a managed service from Google to manage a Spark cluster. - Source: dev.to / about 2 years ago
With that, the best way to maximize processing and minimize time is to use Dataflow or Dataproc depending on your needs. These systems are highly parallel and clustered, which allows for much larger processing pipelines that execute quickly. Source: over 2 years ago
Apache Spark - Apache Spark is an engine for big data processing, with built-in modules for streaming, SQL, machine learning and graph processing.
Amazon EMR - Amazon Elastic MapReduce is a web service that makes it easy to quickly process vast amounts of data.
Tigon - Tigon is an open source real-time stream processing framework built on top of Apache Hadoop and Apache HBase.
Google BigQuery - A fully managed data warehouse for large-scale data analytics.
Lightbend Akka Platform - Lightbend Fast Data Platform is the easy on-ramp to successful streaming Fast Data applications.
HortonWorks Data Platform - The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly...