Hadoop might be a bit more popular than Ceph. We know about 15 links to it since March 2021 and only 11 links to Ceph. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
Did you check out tools like https://hadoop.apache.org/ ? Source: about 1 year ago
There are different ways to implement parallel dataflows, such as using parallel data processing frameworks like Apache Hadoop, Apache Spark, and Apache Flink, or using cloud-based services like Amazon EMR and Google Cloud Dataflow. It is also possible to use parallel dataflow frameworks to handle big data and distributed computing, like Apache Nifi and Apache Kafka. Source: about 1 year ago
There are several frameworks available for batch processing, such as Hadoop, Apache Storm, and DataTorrent RTS. - Source: dev.to / over 1 year ago
A copy of Hadoop installed on each of these machines. You can download Hadoop from the Apache website, or you can use a distribution like Cloudera or Hortonworks. - Source: dev.to / over 1 year ago
The Apache™ Hadoop™ project develops open-source software for reliable, scalable, distributed computing. - Source: dev.to / over 1 year ago
Ceph stands out in storage technology, offering a scalable and reliable solution where traditional systems fall short. It supports object, block, and file storage in one system, adaptable for various environments including on-premises, cloud, or container-native setups. Key benefits include scalability, enabled by the CRUSH algorithm, allowing for expansion without typical downtime. This makes Ceph suitable for... - Source: dev.to / 4 months ago
With that being said, you better take a look at something more WAN optimized and more secure, like S3 storage. You can build the S3 storage (and gain immutability) using something like MinIO (https://min.io/) or Ceph (https://ceph.io/en/) or check out Object First Ootbi offerings - https://objectfirst.com/object-storage/ (I work for them). Source: 9 months ago
I believe Ceph [1] could be a good alternative. It can be self hosted and I believe some cloud providers also offer it. Here are some differences between S3 and Ceph [2]. [1] - https://ceph.io/en/ [2] - https://www.lightbitslabs.com/blog/ceph-storage/. - Source: Hacker News / 11 months ago
Another option is a distributed Ceph cluster https://ceph.io/en/. Source: over 1 year ago
There's also cool systems like https://ceph.io/en/ that could be efficient if willing to set up and learn. Source: over 1 year ago
Apache Spark - Apache Spark is an engine for big data processing, with built-in modules for streaming, SQL, machine learning and graph processing.
Minio - Minio is an open-source minimal cloud storage server.
Apache Cassandra - The Apache Cassandra database is the right choice when you need scalability and high availability without compromising performance.
GlusterFS - GlusterFS is a scale-out network-attached storage file system.
Apache Flink - Flink is a streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations.
StorPool - StorPool is designed from the ground up to provide cloud builders, shared hosting providers and MSPs with the most resource efficient storage software on the market.