Ben Chuanlong Du's Blog

It is never too late to learn.

Filter a Polars LazyFrame in Rust

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Tips and Traps

  1. LazyFrame.filter filters rows using an Expr while DataFrame.filter filters rows using a mask of the type ChunkedArray<BooleanType>.

Hands on the Rust Crate Parquet

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Comments

  1. Notice that a cell in a Parquet table has a type of Field which is an enum of types.

Polars Series in Rust

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Data Frame Implementations in Rust

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Polars

Polars is a fast multi-threaded DataFrame library in Rust and Python.

datafusion

datafusion is an extensible query execution framework, written in Rust, that uses Apache Arrow as its in-memory format …

Hands on the Polars Crate in Rust

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Tips and Traps

  1. Polars is a blazingly fast DataFrames library implemented in Rust using Apache Arrow as memory model. It supports multithreading and lazy computation.

  2. The Rust crate polars has many features . Be sure to include features which are required for your use cases. Below are some commonly useful features.