Dask: Python library for parallel and distributed execution of dynamic task graphs
Dask: Python library for parallel and distributed execution of dynamic task graphs. Dask supports using pyarrow for accessing Parquet files
Category: Free Downloads and Links
Apache Parquet: A columnar storage format
Apache Parquet: A columnar storage format available to any project in the Hadoop ecosystem, regardless of the choice of data processing framework, data model or programming language. The C++ and Java implementation provide vectorized...
Apache Arrow: A cross-language development platform for in-memory data
Apache Arrow is a cross-language development platform for in-memory data. It specifies a standardized language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware. It also provides...
[LeMo Project] Understanding and Mapping Big Data in Transport Sector
BY Kim Hee (1), Naveed Mushtaq (1), Hevin Özmen (1), Marten Rosselli (1), Roberto V. Zicari (1), Minsung Hong (2), Rajendra Akerkar (2), Sophie Roizard (3), Rémy Russotto (3), Tharsis Teoh (4) Goethe‐University Frankfurt...
On Vertica Database, Apache ORC and Parquet. Q&A with Deepak Majeti
Q1. Can you tell us about your work extending Vertica onto the Hadoop ecosystem? The Vertica Analytics Platform was founded in 2005 by Turing Award-winner Michael Stonebraker and his colleagues at MIT and other...
Analysing 1.4 Billion dataset with CortexDB. Q&A with Thomas Kalippke
Q1. Your current showcase is a database with 1.4 Billion dataset (~1.2 TB data file) with taxi trips of New York using the TLC Trip Record Data . What kind of data discovery do you...
Understanding the return on your cloud investments
By Ritesh Ramesh, Data and Analytics Leader, Consumer Markets, PwC U.S Craig Scalise, Ph.D., Senior Research Fellow, PwC U.S. According to a recent Forbes article 1, the seven biggest enterprise cloud...
Pypher gets property map, map, and map projection support
Pypher is a small library that aims to make it easier to use Neo4j from Python by constructing Cypher queries from pure Python objects, and this week Mark Henderson released version 0.7. This version...
Raima Database Manager (RDM) vs. SQLite: Performance Comparison Example
The majority of today’s operating system and hardware support multithreading. SQLite does not take advantage of this opportunity because of the design in SQLite. When there are many concurrent writes to a SQLite database, application users experience a significant reduction in speed and the application may not meet the users performance...
On In-memory Databases and Raima Database. Q&A with Jeff Parsons
Q1. What are the advantages and disadvantages of in-memory databases? In-memory databases, by definition, handle the data they are processing in main memory. There is no need to deal with secondary storage which can...