When IoTDB was initiated in 2011, almost all influential distributed systems and databases were built in Java or on the JVM—such as Hadoop, HBase, Spark (Scala on JVM), Cassandra, Kafka, and Flink. To integrate deeply with the big data ecosystem, choosing Java was a natural decision. - Source: dev.to / 3 months ago

In the meantime, other query engine support is on the roadmap, including Apache Spark, Apache Flink, and others. - Source: dev.to / 11 months ago

Many stream processing systems today still rely on local disks and RocksDB to manage state. This model has been around for a while and works fine in simple, single-tenant setups. Apache Flink, for example, uses RocksDB as its default state backend - state is kept on local disks, and periodic checkpoints are written to external storage for recovery. - Source: dev.to / about 1 year ago

Because the hosted catalog is a standard JDBC catalog, tools like Spark, Trino, and Flink can still access your tables. For example:. - Source: dev.to / about 1 year ago

I wrote a python based aircraft monitor which polls the adsb.fi feed for aircraft transponder messages, and publishes each location update as a new event into an Apache Kafka topic. I used Apache Flink — and more specially Flink SQL, to transform and analyse my flight data. The TL;DR summary is I can write SQL for my real-time data processing queries — and get the scalability, fault tolerance, and low latency... - Source: dev.to / about 1 year ago

Pg Loader is a tool that can be used to move your data to PostgreSQL, however, it's not perfect, but can work well in some cases. It's worth looking at to see if it's the direction you want to go. - Source: dev.to / about 2 years ago

Examples (for Common Lisp, so not citing Emacs): reddit v1, Google's ITA Software that powers airfare search engines (Kayak, Orbitz…), Postgres' pgloader (http://pgloader.io/), which was re-written from Python to Common Lisp, Opus Modus for music composition, the Maxima CAS, PTC 3D designer CAD software (used by big brands worldwide), Grammarly, Mirai, the 3D editor that designed Gollum's face, the ScoreCloud app... - Source: Hacker News / over 2 years ago

I worked on migrating our MySQL system to PostgreSQL using pgloader ( https://pgloader.io/ ). There were some hiccups, things that needed clarification in documentation, and some additional processes that needed to be done outside of the system to get everything we need in place, it was a amazing help. Not sure the project would've been possible without it. Data mapping from PostgreSQL to PostgreSQL as in the... - Source: Hacker News / over 2 years ago

Initially, I started down the pgloader path, which seemed to be a common approach for the database conversion. However, using my M1-chip MacBook Pro led to some unexpected issues. Instead, I opted to use NMIG to convert MySQL to PostgreSQL. For more information, please check out the “Highlights From the Database Conversion” section below. - Source: dev.to / over 3 years ago

I would warmly recommend https://pgloader.io but, unfortunately, the Oracle support is still in need of a sponsor :-). Source: over 3 years ago