Big Data Tools

Apache Spark is an engine for big data processing, with built-in modules for streaming, SQL, machine learning and graph processing.

Open Source

Amazon Elastic MapReduce is a web service that makes it easy to quickly process vast amounts of data.

Fully managed extract, transform, and load (ETL) service

Splunk's operational intelligence platform helps unearth intelligent insights from machine data.

Apache Beam provides an advanced unified programming model to implement batch and streaming data processing jobs.

Open Source

Oracle Big Data offers solutions to help organize and analyze diverse data sources alongside existing data.

AWS Database Migration Service allows you to migrate to AWS quickly and securely. Learn more about the benefits and the key use cases.

Google Cloud Dataflow is a fully-managed cloud service and programming model for batch and streaming big data processing.

Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. Athena is serverless, so there is no infrastructure to manage, and you pay only for the queries that you run.

Flink is a streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations.

Open Source

The Starfish ETL (Extract Transform Load) Suite is a CRM integration and migration tool.

Distributed SQL Query Engine for Big Data (by Facebook)

Open Source

Quatrix provides simple one step web based file sharing for end users with enterprise-level controls, empowering IT to enforce compliance, data protection & information security policies through granular administrative controls and a full audit trial