Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Apache Arrow Flight is the future protocol for querying Databases! It use columnar data and leverages Apache Arrow to avoid unnecessary copy of data, which makes it able to query large …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
| Data Type | C | C++ | Rust | Java | Python | numpy | pyarrow | Spark SQL | SQL |
|---|---|---|---|---|---|---|---|---|---|
| 8 bit integer | short (16-bit) | int8_t | i8 | short (16-bit) | int (arbitrary precision) | int8 | TinyInt … |
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
[Feather vs Parquet]https://github.com/wesm/feather/issues/188
https://github.com/wesm/feather
https://github.com/apache/arrow
https://stackoverflow.com/questions/54582073/sharing-objects-across-workers-using-pyarrow
https://github.com/pytorch/pytorch/issues/13039
https://issues.apache.org/jira/browse/ARROW-5130
https://uwekorn.com/2019/09/15/how-we-build-apache-arrows-manylinux-wheels.html