Apache Spark VS ClickHouse

Apache Spark Reviews

ClickHouse Reviews

Apache Spark mentions (56)

• Groovy 🎷 Cheat Sheet - 01 Say "Hello" from Groovy

  Recently I had to revisit the "JVM languages universe" again. Yes, language(s), plural! Java isn't the only language that uses the JVM. I previously used Scala, which is a JVM language, to use Apache Spark for Data Engineering workloads, but this is for another post 😉. - Source: dev.to / about 2 months ago

• 🦿🛴Smarcity garbage reporting automation w/ ollama

  Consume data into third party software (then let Open Search or Apache Spark or Apache Pinot) for analysis/datascience, GIS systems (so you can put reports on a map) or any ticket management system. - Source: dev.to / 3 months ago

• Go concurrency simplified. Part 4: Post office as a data pipeline

  Also, this knowledge applies to learning more about data engineering, as this field of software engineering relies heavily on the event-driven approach via tools like Spark, Flink, Kafka, etc. - Source: dev.to / 4 months ago

• Five Apache projects you probably didn't know about

  Apache SeaTunnel is a data integration platform that offers the three pillars of data pipelines: sources, transforms, and sinks. It offers an abstract API over three possible engines: the Zeta engine from SeaTunnel or a wrapper around Apache Spark or Apache Flink. Be careful, as each engine comes with its own set of features. - Source: dev.to / 4 months ago

• Spark – A micro framework for creating web applications in Kotlin and Java

  A JVM based framework named "Spark", when https://spark.apache.org exists? - Source: Hacker News / 10 months ago

ClickHouse mentions (43)

• The 2024 Web Hosting Report

  For the third, examples here might be analytics plugins in specialized databases like Clickhouse, data-transformations in places like your ETL pipeline using Airflow or Fivetran, or special integrations in your authentication workflow with Auth0 hooks and rules. - Source: dev.to / 2 months ago

• Choosing Between a Streaming Database and a Stream Processing Framework in Python

  Online analytical processing (OLAP) databases like Apache Druid, Apache Pinot, and ClickHouse shine in addressing user-initiated analytical queries. You might write a query to analyze historical data to find the most-clicked products over the past month efficiently using OLAP databases. When contrasting with streaming databases, they may not be optimized for incremental computation, leading to challenges in... - Source: dev.to / 2 months ago

• Real-Time Data Enrichment and Analytics With RisingWave and ClickHouse

  To achieve seamless real-time data ingestion, transformation, and analytics, a powerful combination to explore is RisingWave and ClickHouse. RisingWave is a PostgreSQL-compatible database specifically designed for stream processing. It excels at ingesting real-time data streams, performing diverse transformations, and enabling instant querying of results. ClickHouse® is a high-performance, column-oriented SQL... - Source: dev.to / 4 months ago

• Ask HN: Is there a Hacker News takeout to export my comments / upvotes, etc.?

  You can export the whole dataset as described here: https://github.com/ClickHouse/ClickHouse/issues/29693

      curl https://clickhouse.com/ | sh.

  - Source: Hacker News / 4 months ago

• Best alternative

  Nowadays I am looking at the clickhouse and how it might help me maybe you can check it out: https://clickhouse.com/. Source: 4 months ago