Show HN: Query SQLite files stored in S3

1

Observable

#Data Visualization #Data Dashboard #Data Science Notebooks 312 social mentions

2

Amazon Athena

> attempting to square-peg-round-hole something like this into AWS S3 I don't think it's like that. AWS already offers services like S3 Select[0] or Athena[1] that do something similar. > the user is merely invited to retry Another reason why I used s3fs instead of manually making requests. > Why not just use the right tool for the job? I certainly have multiple uses-cases where creating an SQLite database locally and distributing it via S3 (for read-only usage) is orders of magnitude more convenient than the alternatives. It's hard to beat the developer experience of a local SQLite database. [0]: https://docs.aws.amazon.com/AmazonS3/latest/API/API_SelectObjectContent.html [1]: https://aws.amazon.com/athena/.

#Data Analysis #ETL #Business Intelligence 23 social mentions