You can use my SQL spreadsheet app: https://superintendent.app I had a similar problem at work where I needed to do some formula on a 5 GB CSV file. Excel can't handle more than 1M rows. Database is too clunky. Eventually I built a GUI wrapper on SQLite, and it grew into Superintendent.app. - Source: Hacker News / 19 days ago

Desktop first made me think of Superintendant[0] which I’ve enjoyed using 0: https://superintendent.app/. - Source: Hacker News / 10 months ago

Project 3: Electron with typescripts. 15 paying users. Source: 12 months ago

That is exactly https://superintendent.app (disclaimer: I'm the creator). - Source: Hacker News / over 1 year ago

Well, shameless plug. https://superintendent.app (paid with free trial) enables you to load a bunch of CSVs and write SQL on those CSV files. It's a much faster to work with if you know SQL well. It can also handle millions of rows easily (e.g. Loading 1GB CSV file takes 10s on Macbook Pro). I initially built it because I had to identify the mismatched transactions between 2 giant CSVs using "full outer join". - Source: Hacker News / over 1 year ago

Jello let’s you use python syntax with dot notation without the stdin/stdout/json.loads boilerplate. https://github.com/kellyjonbrazil/jello. - Source: Hacker News / 9 months ago

A couple more alternatives: https://github.com/kellyjonbrazil/jello. - Source: Hacker News / 9 months ago

Yep, you can create a filter in jq to do that. Alternatively, if you prefer Python syntax you could try jello, which works like jq but is really Python under the hood. (I am also the author of jello). Source: over 1 year ago

Hi there - I'm the author of `jc`. I also created `jello`[0], which works just like `jq` but uses python syntax. I find `jq` is great for many things but sometimes more complex operations are easier for me to grok in python. [0] https://github.com/kellyjonbrazil/jello. - Source: Hacker News / over 1 year ago

I'm no expert in any of these tools, but here are some yamlpath and jello examples to match:. Source: about 2 years ago