Amazon EMR VS Snowflake

Amazon EMR Reviews

Snowflake Reviews

Amazon EMR mentions (10)

• 5 Best Practices For Data Integration To Boost ROI And Efficiency

  There are different ways to implement parallel dataflows, such as using parallel data processing frameworks like Apache Hadoop, Apache Spark, and Apache Flink, or using cloud-based services like Amazon EMR and Google Cloud Dataflow. It is also possible to use parallel dataflow frameworks to handle big data and distributed computing, like Apache Nifi and Apache Kafka. Source: about 1 year ago

• What compute service i should use? Advice for a duck-tape kind of guy

  I'm going to guess you want something like EMR. Which can take large data sets segment it across multiple executors and coalesce the data back into a final dataset. Source: almost 2 years ago

• Processing a large text file containing millions of records.

  This is exactly the kind of workload EMR was made for, you can even run it serverless nowadays. Athena might be a viable option as well. Source: almost 2 years ago

• How to use Spark and Pandas to prepare big data

  Apache Spark is one of the most actively developed open-source projects in big data. The following code examples require that you have Spark set up and can execute Python code using the PySpark library. The examples also require that you have your data in Amazon S3 (Simple Storage Service). All this is set up on AWS EMR (Elastic MapReduce). - Source: dev.to / over 2 years ago

• Beginner building a Hadoop cluster

  Check out https://aws.amazon.com/emr/. Source: about 2 years ago

Snowflake mentions (4)

• DeWitt Clause, or Can You Benchmark %DATABASE% and Get Away With It

  Snowflake, a data warehousing company founded by ex-Oracle and ex-VectorWise experts, responded with a blog post that critically reviewed Databricks' findings, reported different results for the same benchmark, and claimed comparable price/performance to Databricks. - Source: dev.to / almost 2 years ago

• Personal Support at Internet Scale

  Snowflake: Snowflake is fast, and works well as a product analytics database. - Source: dev.to / over 2 years ago

• Less than 1TB of data what tools should I get better at?

  If you just go to snowflake.com you can sign up for a demo account for free for a month and I'm fairly certain you can get more than one of these accounts (I would recycle emails doing it all the time.) Once you have an account there's lots of docs and videos out there either using the Database via their UI or via python using their connector. They also have a pyspark connector but you might want to just learn... Source: over 2 years ago

• *BOMATO*

  Early stage funding & VCs clearly demarcate between tech companies and tech enabled companies. But, once the PE comes into the picture at the scale of BlackStone, the border between doordash.com and snowflake.com starts to blur. The motivation is to make some bucks by going to IPO and they know how to get it done. Source: over 2 years ago