Page 7 - Apache Arrow News Today

Voltron Data was launched last year by former employees from NVidia, Ursa Computing, BlazingSQL and the co-founder of Apache Arrow. The group came together to build a company on top of Arrow to help companies that don’t want to deal with the headaches of managing an open source project on their own. Voltron Data co-founder […]

Hello friends and welcome to Daily Crunch, bringing you the most important startup, tech and venture capital news in a single package.

Data lake and data analytics software developer Dremio becomes a $2 billion company with $160 million funding round.

Polars is a blazingly fast DataFrame library completely written in Rust, using the Apache Arrow memory model. It exposes bindings for the popular Python and soon JavaScript languages. Polars supports a full lazy execution API allowing query optimization.

BlazingSQL builds on RAPIDS to distribute SQL query execution across GPU clusters, delivering the ETL for an all-GPU data science workflow.

Developers and enthusiasts interested in learning more about Machine Learning frameworks may be interested in a new framework

Making great efforts to tout its closed source software, Snowflake may be trying to convince an audience that doesn't really care.

I’ve recently been getting pretty far into the weeds about what the future of data programming is going to look like. I use pandas and dplyr in python and R respectively. But I’m starting to see the shape of something that’s interesting coming down the pike. I’ve been working on a project that involves scatterplot visualizations at a massive scale–up to 1 billion points sent to the browser. In doing this, two things have become clear:

Any significant improvement in processing times will be a boon to productivity, say analysts Lindsay Clark Wed 17 Mar 2021 // 14:45 UTC Share Copy Informatica has announced a serverless, Spark-based data integration engine intended to accelerate data engineering for machine learning in the cloud using Nvidia GPU processors. Within the vendors integration platform-as-a-service, CDI Elastic, microservices support different data management activities. The new capability is ...

A Hybrid Apache Arrow/Numpy DataFrame with Vaex version 4.0 A Hybrid Apache Arrow/Numpy DataFrame with Vaex version 4.0 The Vaex DataFrame has always been very fast. Built from the ground up to be out of core (the size of your disk is the limit), it pushes the limits of what single machines can do in the context of big data analysis. Starting from version 2, we added better support for string data, giving an almost 1000x speedup compared to Pandas at the time. To support this seemingly ...