For the data loaded from the raw and unstructured data sources (RESTful APIs, files, feeds) I'd recommend checking tablum.io. The data first gets into the staging SQL DB where you can apply transformations in SQL (ClickHouse dialect with hundreds of ready-to-use functions for aggregations, transformations, string and array processing, etc). After that, you can set up a pipeline to external DWH or DB. Or just... Source: almost 2 years ago

Fairly easy to parse it with Python (or any other scripting languages that support regular expressions). Besides, there're no-code parsers that can do that. E.g. tablum.io, it has a regexp parser that turns poorly formatted text into an SQL table. All you need it is to provide the regular expression (regexp) to split the text (per-line basis or the entire text) into chunks that become SQL rows and columns, after... Source: about 2 years ago

You're right. There should be some way to safely pass the authentication token without storing it in the query. BTW, to keep all data within the company network perimeter and no share any keys with the cloud service, one can install tablum.io as a self-hosted version on a Linux server (it runs in Docker). Source: about 2 years ago

That’s why I created JSONsilo—a free tool that makes hosting JSON files easy. Here’s why it’s perfect for prototyping and small projects. - Source: dev.to / about 1 month ago

Whether you’re a developer, student, or small business owner, JSONsilo.com is here to make hosting JSON files simple and free. Visit JSONsilo.com to get started! - Source: dev.to / 4 months ago