pandas: data analysis toolkit for Python
pandas: data analysis toolkit for Python programmers. pandas supports reading and writing Parquet files using pyarrow. Several pandas core developers are also contributors to Apache Arrow.
Category: Free Downloads and Links
MapD: in-memory columnar SQL engine designed to run on GPUs
MapD: in-memory columnar SQL engine designed to run on GPUs. MapD supports Arrow for data ingest and data interchange via CUDA IPC handles. This work is part of the GPU Open Analytics Initiative
Fletcher: FPGA acceleration framework
Fletcher: Fletcher is an FPGA acceleration framework that can convert an Arrow schema into an easy-to-use hardware interface. The accelerator can request data from Arrow tables by supplying row indices. In turn, the interface...
Dremio: A self-service data platform.
Dremio: A self-service data platform. Dremio makes it easy for users to discover, curate, accelerate, and share data from any source. It includes a distributed SQL execution engine based on Apache Arrow. Dremio reads...
Dask: Python library for parallel and distributed execution of dynamic task graphs
Dask: Python library for parallel and distributed execution of dynamic task graphs. Dask supports using pyarrow for accessing Parquet files
Apache Parquet: A columnar storage format
Apache Parquet: A columnar storage format available to any project in the Hadoop ecosystem, regardless of the choice of data processing framework, data model or programming language. The C++ and Java implementation provide vectorized...
Apache Arrow: A cross-language development platform for in-memory data
Apache Arrow is a cross-language development platform for in-memory data. It specifies a standardized language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware. It also provides...
[LeMo Project] Understanding and Mapping Big Data in Transport Sector
BY Kim Hee (1), Naveed Mushtaq (1), Hevin Özmen (1), Marten Rosselli (1), Roberto V. Zicari (1), Minsung Hong (2), Rajendra Akerkar (2), Sophie Roizard (3), Rémy Russotto (3), Tharsis Teoh (4) Goethe‐University Frankfurt...
On Vertica Database, Apache ORC and Parquet. Q&A with Deepak Majeti
Q1. Can you tell us about your work extending Vertica onto the Hadoop ecosystem? The Vertica Analytics Platform was founded in 2005 by Turing Award-winner Michael Stonebraker and his colleagues at MIT and other...
Analysing 1.4 Billion dataset with CortexDB. Q&A with Thomas Kalippke
Q1. Your current showcase is a database with 1.4 Billion dataset (~1.2 TB data file) with taxi trips of New York using the TLC Trip Record Data . What kind of data discovery do you...