MLPerf–ML benchmark suite
A broad ML benchmark suite for measuring performance of ML software frameworks, ML hardware accelerators, and ML cloud platforms. LINK TO WEB SITE Overview The MLPerf effort aims to build a common set of...
Category: Big Data, Analytical Data Platforms, AI and Data Science
How AI and NLP can broaden data discovery, accessibility and maintain governance.
By Ayush Parashar, Co-Founder and Vice President of Engineering, Unifi Software The challenge of controlling and protecting data is a big one, but the bigger question is how to make people more productive with...
GeoMesa: A suite of tools that enables large-scale geospatial query and analytics on distributed computing systems.
GeoMesa: A suite of tools that enables large-scale geospatial query and analytics on distributed computing systems. GeoMesa supports query results in the Arrow IPC format, which can then be used for in-browser visualizations and/or...
libgdf: A C library of CUDA-based analytics functions and GPU IPC support for structured data
libgdf: A C library of CUDA-based analytics functions and GPU IPC support for structured data. Uses the Arrow IPC format and targets the Arrow memory layout in its analytic functions. This work is part...
Perspective: streaming data visualization engine
Perspective: Perspective is a streaming data visualization engine in JavaScript for building real-time & user-configurable analytics entirely in the browser.
Quilt Data: data package manager
Quilt Data: Quilt is a data package manager, designed to make managing data as easy as managing code. It supports Parquet format via pyarrow for data access.
Ray: A flexible, high-performance distributed execution framework with a focus on machine learning and AI
Ray: A flexible, high-performance distributed execution framework with a focus on machine learning and AI applications. Uses Arrow to efficiently store Python data structures containing large arrays of numerical data. Data can be accessed...
Red Data Tools: A project that provides data processing tools for Ruby
Red Data Tools: A project that provides data processing tools for Ruby. It provides Red Arrow that is a Ruby bindings of Apache Arrow based on Apache Arrow GLib. Red Arrow is a core...
Turbodbc: Python module to access relational databases via the Open Database Connectivity (ODBC) interface.
Turbodbc: Python module to access relational databases via the Open Database Connectivity (ODBC) interface. It provides the ability to return Arrow Tables and RecordBatches in addition to the Python Database API Specification 2.0.
pandas: data analysis toolkit for Python
pandas: data analysis toolkit for Python programmers. pandas supports reading and writing Parquet files using pyarrow. Several pandas core developers are also contributors to Apache Arrow.