Stay updated with breaking news from Apache Parquet. Get real-time updates on events, politics, business, and more. Visit us for reliable news and exclusive interviews.
In the past few years, I've heard a lot about Avro, Parquet, ORC, Arrow and Feather, but I also keep hearing about Iceberg and Delta Lake. As a "database person", I’ve been struggling to understand all of these different things, and how they relate to Data Lakes and Data
Voltron Data introduces Theseus, a powerful distributed query engine designed to accelerate large-scale data pipelines and queries, optimize data processing for AI workloads, and promote open interoperability, all while pushing beyond traditional CPU approaches by leveraging GPU and other hardware accelerators.
The capability is arguably the most significant in a series of updates to Microsoft Fabric -- and is a shot against emerging competitors like Databricks and Snowflake. It allows the sharing of data from databases even with proprietary data formats, and also placing pressure on Microsoft’s cloud competitors Google, and especially Amazon, which have not moved as quickly to embrace open formats.
Apache Arrow defines an in-memory columnar data format that accelerates processing on modern CPU and GPU hardware, and enables lightning-fast data access between systems.
Python pandas creator Wes McKinney has joined data science company Posit as a principal architect, signaling the company's efforts to play a bigger role in the Python universe as well as the R ecosystem.