For the data loaded from the raw and unstructured data sources (RESTful APIs, files, feeds) I'd recommend checking tablum.io. The data first gets into the staging SQL DB where you can apply transformations in SQL (ClickHouse dialect with hundreds of ready-to-use functions for aggregations, transformations, string and array processing, etc). After that, you can set up a pipeline to external DWH or DB. Or just... Source: about 1 year ago

Fairly easy to parse it with Python (or any other scripting languages that support regular expressions). Besides, there're no-code parsers that can do that. E.g. tablum.io, it has a regexp parser that turns poorly formatted text into an SQL table. All you need it is to provide the regular expression (regexp) to split the text (per-line basis or the entire text) into chunks that become SQL rows and columns, after... Source: about 1 year ago

You're right. There should be some way to safely pass the authentication token without storing it in the query. BTW, to keep all data within the company network perimeter and no share any keys with the cloud service, one can install tablum.io as a self-hosted version on a Linux server (it runs in Docker). Source: about 1 year ago

There exist many different tools that help convert JSON data to other formats like XML, CSV, YAML, etc. One tool that I've liked within this category is Konklone.io, built by Eric Mill, because it acts as a lightweight and simple tool to help quickly convert JSON data into CSV. - Source: dev.to / about 1 year ago

That spits back a bunch of JSON code in the browser that I saved as a text file. I then used a website like JSON TO CSV Converter to convert the JSON to a tabular csv format. The result is a table that has a row for each time I listened to the track, when and how long I listened to it as well as the other standard data like which app and platform I used to listen, the track information such as album, artist etc. Source: over 2 years ago

Https://konklone.io/json/ has always worked well for me. Source: almost 3 years ago

I used Overpass Turbo to search for shop=*, then export > copy geojson, paste into https://konklone.io/json/ and then downloaded the csv file to open in Excel. Source: almost 3 years ago