Cloud Dataprep might be a bit more popular than Google Cloud Dataproc. We know about 3 links to it since March 2021 and only 3 links to Google Cloud Dataproc. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
I have also a spark cluster created with google cloud dataproc. Source: about 1 year ago
Specifically, we heavily rely on managed services from our cloud provider, Google Cloud Platform (GCP), for hosting our data in managed databases like BigTable and Spanner. For data transformations, we initially heavily relied on DataProc - a managed service from Google to manage a Spark cluster. - Source: dev.to / almost 2 years ago
With that, the best way to maximize processing and minimize time is to use Dataflow or Dataproc depending on your needs. These systems are highly parallel and clustered, which allows for much larger processing pipelines that execute quickly. Source: over 2 years ago
Check Google Cloud Dataprep – requires no coding, you can normalize & clean up the data as well. I've done this many times, saved me headaches from dirty data in Excel files. Source: almost 2 years ago
Not sure if I understand the request but a commercial tool I know of is https://cloud.google.com/dataprep - it sounds like that could be helpful but I am not sure. Source: over 2 years ago
If you need to adjust the underlying data, you can use Cloud Dataprep to do manipulations (here). Source: about 3 years ago
Amazon EMR - Amazon Elastic MapReduce is a web service that makes it easy to quickly process vast amounts of data.
Amazon SageMaker - Amazon SageMaker provides every developer and data scientist with the ability to build, train, and deploy machine learning models quickly.
Google BigQuery - A fully managed data warehouse for large-scale data analytics.
GeoSpock - GeoSpock is the platform for data lake management, providing a unified view of the data assets within an organization and making it easily accessible.
HortonWorks Data Platform - The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly...
Delta Lake - Application and Data, Data Stores, and Big Data Tools