Based on our record, Apache Spark should be more popular than DuckDB. It has been mentiond 56 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
More than once, I have been in a situation where I needed to query CloudTrail logs but was working in a customer environment where they weren’t aggregated to a search interface. Another similar situation is when CloudTrail data events are disabled for cost reasons but need to be temporarily turned on for troubleshooting/audit purposes. While the CloudTrail console offers some (very) limited lookups (for management... - Source: dev.to / 3 days ago
DuckDB: An in-process SQL OLAP database management system. While not a traditional OLAP database, DuckDB is designed to execute analytical queries efficiently, making it suitable for analytical workloads within data-intensive applications. - Source: dev.to / 3 months ago
Easiest way to practically use SIMD table scan database is try out DuckDB: https://duckdb.org/. - Source: Hacker News / 3 months ago
Duckdb so we can make OLAP like queries on the data. - Source: dev.to / 6 months ago
DuckDB is an open source (MIT) high-performance, in-process SQL database for analytics. It is a relatively new project (the first public release was in June 2019), but got tremendously popular in a short period of time. - Source: dev.to / 6 months ago
Recently I had to revisit the "JVM languages universe" again. Yes, language(s), plural! Java isn't the only language that uses the JVM. I previously used Scala, which is a JVM language, to use Apache Spark for Data Engineering workloads, but this is for another post 😉. - Source: dev.to / 3 months ago
Consume data into third party software (then let Open Search or Apache Spark or Apache Pinot) for analysis/datascience, GIS systems (so you can put reports on a map) or any ticket management system. - Source: dev.to / 4 months ago
Also, this knowledge applies to learning more about data engineering, as this field of software engineering relies heavily on the event-driven approach via tools like Spark, Flink, Kafka, etc. - Source: dev.to / 5 months ago
Apache SeaTunnel is a data integration platform that offers the three pillars of data pipelines: sources, transforms, and sinks. It offers an abstract API over three possible engines: the Zeta engine from SeaTunnel or a wrapper around Apache Spark or Apache Flink. Be careful, as each engine comes with its own set of features. - Source: dev.to / 5 months ago
A JVM based framework named "Spark", when https://spark.apache.org exists? - Source: Hacker News / 11 months ago
Apache Druid - Fast column-oriented distributed data store
Apache Flink - Flink is a streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations.
OctoSQL - OctoSQL is a query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL. - cube2222/octosql
Apache Airflow - Airflow is a platform to programmaticaly author, schedule and monitor data pipelines.
MonetDB - Column-store database
Hadoop - Open-source software for reliable, scalable, distributed computing