You can use my SQL spreadsheet app: https://superintendent.app I had a similar problem at work where I needed to do some formula on a 5 GB CSV file. Excel can't handle more than 1M rows. Database is too clunky. Eventually I built a GUI wrapper on SQLite, and it grew into Superintendent.app. - Source: Hacker News / 8 days ago

Desktop first made me think of Superintendant[0] which I’ve enjoyed using 0: https://superintendent.app/. - Source: Hacker News / 10 months ago

Project 3: Electron with typescripts. 15 paying users. Source: 11 months ago

That is exactly https://superintendent.app (disclaimer: I'm the creator). - Source: Hacker News / over 1 year ago

Well, shameless plug. https://superintendent.app (paid with free trial) enables you to load a bunch of CSVs and write SQL on those CSV files. It's a much faster to work with if you know SQL well. It can also handle millions of rows easily (e.g. Loading 1GB CSV file takes 10s on Macbook Pro). I initially built it because I had to identify the mismatched transactions between 2 giant CSVs using "full outer join". - Source: Hacker News / over 1 year ago

I'd you're trying to bring this to a wider audience not already familiar with q, then the name collision with the more widely known jq project is a problem: https://stedolan.github.io/jq/. - Source: Hacker News / 5 months ago

First, we need to install jq via the installer available at https://stedolan.github.io/jq/. - Source: dev.to / 6 months ago

JQ is a lightweight and powerful command-line JSON processor. It's a time-saving tool for manipulating and extracting data from JSON files effortlessly. - Source: dev.to / 8 months ago

If you have jq installed you can use it to make the output look nicer. - Source: dev.to / about 1 year ago

It requires jq for JSON processing and GNU parallel for concurrent searches in the notebooks. - Source: dev.to / about 1 year ago