For anyone interested in exploring the data yourself, here are a few tools https://dadroit.com/: desktop tool for processing large JSON files.There’s a free version so you can get pretty far with it if you’re patient https://www.dolthub.com/repositories/dolthub/quest: they’re running a bounty program for some healthcare providers to process the machine readable files, and have some useful code snippets in case... - Source: Hacker News / over 1 year ago

Note for people who don't know much about FreePascal. It is a full-featured and very fast compiler. The resulting program is a rival for the best output of C/CPP compilers. It can be used in the style of simpler languages like Go and is almost as safe as Rust in a much faster manner. It has a great but old-looking IDE, Lazarus. It has been under active development for decades and is used for proper projects like:... - Source: Hacker News / over 1 year ago

The files are insanely large. Eventually the only way I've been able to open them is using the DADROIT large JSON viewer: http://dadroit.com (but even this only worked when I got an M1 Mac). Source: over 1 year ago

For those looking for the ability to (locally) open and query very large JSON files, Dadroit is great: https://dadroit.com. It's been a while since I used it last, but it was a life saver for me when working with JSON lines files in S3 and Kafka log dumps. A side tidbit, IIRC, it was written in Pascal. - Source: Hacker News / over 1 year ago

You can review all the contents of it, but generally, there is one big 5GB JSON file — yelp_academic_dataset_review.json it contains 6,9 🍋 JSON records. Use Dadroid to review massive JSON files. - Source: dev.to / over 1 year ago

Not all that curious... https://flatfile.com If you're building a vertical SaaS and want to support import from a file, and don't want to spend time reinventing the wheel, this could be a big win. This would let new users bring in existing data from another SaaS (that supports CSV export) or where the incumbent is likely to be Excel. The development time it would take to make something like this solid, usable, and... - Source: Hacker News / 10 months ago

If you are a software developer, think about how you could add the data import, transformation, and validation functionality to your web app in only a few minutes with your JavaScript and React knowledge using built-in SDK and libraries. You can think of using SDK such as the front-end Embed React library in the Flatfile. If you need to define more complex data validation rules in a backend, you can request... - Source: dev.to / 11 months ago

YoBulk is an open-source CSV importer for any SaaS application - It's a free alternative to https://flatfile.com/. Source: over 1 year ago

Hey Everybody, We are really excited to open source YoBulk today. YoBulk is an open source CSV importer for any SaaS application - It's a free alternative to https://flatfile.com/ Why are we building YoBulk: In our previous startup, we were receiving CSV files from various billboard screen owners every day, following a specific template that we defined. Despite the well-defined template, the CSV files we received... - Source: Hacker News / over 1 year ago

Spreadsheet data ingestion. Someone did built it, but it was years after: https://flatfile.com/ Not a plug. I'm unaffiliated and just impressed by it. Should've thought of it myself. - Source: Hacker News / over 1 year ago