Based on our record, Apache Arrow should be more popular than SQLite. It has been mentiond 33 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
In comes Polars: a brand new dataframe library, or how the author Ritchie Vink describes it... a query engine with a dataframe frontend. Polars is built on top of the Arrow memory format and is written in Rust, which is a modern performant and memory-safe systems programming language similar to C/C++. - Source: dev.to / about 2 months ago
One is related to the heritage of being built around the NumPy library, which is great for processing numerical data, but becomes an issue as soon as the data is anything else. Pandas 2.0 has started to bring in Arrow, but it's not yet the standard (you have to opt-in and according to the developers it's going to stay that way for the foreseeable future). Also, pandas's Arrow-based features are not yet entirely on... - Source: dev.to / 5 months ago
IMO a good first step would be to use the txr FFI to write a library for Apache arrow: https://arrow.apache.org/. - Source: Hacker News / 5 months ago
Polars is an open-source library for Python, Rust, and NodeJS that provides in-memory dataframes, out-of-core processing capabilities, and more. It is based on the Rust implementation of the Apache Arrow columnar data format (you can read more about Arrow on my earlier blog post “Demystifying Apache Arrow”), and it is optimised to be blazing fast. - Source: dev.to / 11 months ago
Apache Arrow (Arrow for short) is an open source project that defines itself as "a language-independent columnar memory format" (more on that later). It is part of the Apache Software Foundation, and as such is governed by a community of several stakeholders. It has implementations in several languages (C++ and also Rust, Julia, Go, and even JavaScript) and bindings for Python, R and others that wrap the C++... - Source: dev.to / 11 months ago
Yes. A Lightroom catalog file is, after all, just a SQLite database. (Srsly, make a copy of your catalog file, rename it whatever.sqlite and use your favorite SQLite GUI to rip it open and look at the tables and fields). It's just storing the pathame to the RAW file for that file's record in the database. Source: 11 months ago
I use visidata with a playback script I recorded to open the sheet to a specific Excel tab, add a column, save the sheet as a csv file. Then I have a sqlite script that takes the csv file and puts it in a database, partitioned by monthYear. Source: about 1 year ago
Use the most-used database in the world: https://sqlite.org/index.html. Source: about 1 year ago
With this in mind, I wrote a few versions of this post, but I hated them all. Then I realized that jodliterate PDF documents mostly do what I want. So, instead of rewriting MirrorXref.pdf, I will make a few comments about jodliterate group documents in general. If you're interested in using SQLite with J, download the self-contained GitHub files MirrorXref.ijs and MirrorXref.pdf and have a look. - Source: dev.to / over 1 year ago
SQLite, by many estimates, is the most widely deployed SQL database system on Earth. It's everywhere. It's in your phone, your laptop, your cameras, your car, your cloud, and your breakfast cereal. SQLite's global triumph is a gratifying testament to the virtues of technical excellence and the philosophy of "less is more.". - Source: dev.to / over 1 year ago
Delta Lake - Application and Data, Data Stores, and Big Data Tools
PostgreSQL - PostgreSQL is a powerful, open source object-relational database system.
Redis - Redis is an open source in-memory data structure project implementing a distributed, in-memory key-value database with optional durability.
MySQL - The world's most popular open source database
Microsoft SQL - Microsoft SQL is a best in class relational database management software that facilitates the database server to provide you a primary function to store and retrieve data.
Apache Cassandra - The Apache Cassandra database is the right choice when you need scalability and high availability without compromising performance.