A SQLite extension for reading large files line-by-line

1

Observable

Hey, author here, happy to answer any questions! Also checkout this notebook for a deeper dive into sqlite-lines, along with a slick WASM demonstration and more thoughts on the codebase itself https://observablehq.com/@asg017/introducing-sqlite-lines I really dig SQLite, and I believe SQLite extensions will push it to another level. I rarely reach for Pandas or other "traditional" tools and query languages, and instead opt for plain ol' SQLite and other extensions. As a shameless plug, I recently started a blog series on SQLite and related tools and extensions if you want to learn more! Next week I'll be publishing more SQLite extensions for parsing HTML + making HTTP requests https://observablehq.com/@asg017/a-new-sqlite-blog-series A few other SQLite extensions: - xlite, for reading Excel files, in Rust https://github.com/x2bool/xlite - sqlean, several small SQLite extensions in C https://github.com/nalgeon/sqlean - mergestat, several SQLite extensions for developers (mainly Github's API) in Go https://github.com/mergestat/mergestat.

#Data Visualization #Data Dashboard #Data Science Notebooks 286 social mentions

2

OctoSQL

And as you can see, the results go in a very different direction. [0]: https://github.com/cube2222/octosql [1]: https://github.com/dcmoura/spyql/blob/master/notebooks/json_benchmark.ipynb.

#Databases #Big Data #Relational Databases 22 social mentions