10+ users can lead to washout: Data lakes struggle with SQL

10+ users can lead to washout: Data lakes struggle with SQL concurrency, says Gartner


Meanwhile, AWS's data lake – Elastic Map Reduce – can handle SQL queries via SQL Workbench or Presto SQL. Azure supports SQL queries in its data lakes (HD Insight or Azure Databricks) while GCP uses a combination of Bigtable, Dataflow and Bigquery.
But these implementations are not able to handle the number of SQL queries supported by "traditional" data warehouses, some of which can scale to thousands of concurrent users.
Latency and concurrency an issue
Pal told the Gartner Data & Analytics Summit: "Data lakes are actually not being used for BI workloads, especially in large organizations that need high concurrency, as well as low latency. The SQL engines that have been developed on the data lakes have never really been able to keep up with the concurrency and latency requirements."

Related Keywords

Ali Ghodsi , Sumit Pal , Gartner , Delta Lake , Elastic Map Reduce , Dazure Databricks , Gartner Data , Analytics Summit , Tsql , சுமிட் நண்பா , கார்ட்னர் , டெல்டா ஏரி , மீள் வரைபடம் குறைக்க , கார்ட்னர் தகவல்கள் , பகுப்பாய்வு உச்சிமாநாடு , சதுர ,

© 2025 Vimarsana