A Polars exploration into Kedro

1

Pandas

Traditionally Kedro has favoured pandas as a dataframe library because of its ubiquity and popularity. This means that, for example, to read a CSV file, you would add a corresponding entry to the catalog:.

#Data Science And Machine Learning #Data Science Tools #Python Tools 198 social mentions

2

Apache Arrow

Polars is an open-source library for Python, Rust, and NodeJS that provides in-memory dataframes, out-of-core processing capabilities, and more. It is based on the Rust implementation of the Apache Arrow columnar data format (you can read more about Arrow on my earlier blog post “Demystifying Apache Arrow”), and it is optimised to be blazing fast.

#Databases #NoSQL Databases #Relational Databases 33 social mentions