1. https://appdevelopermagazine.com/programming
  2. https://appdevelopermagazine.com/low-latency-ingestion-and-optimization-for-apache-iceberg/
1/27/2025 7:59:31 AM
Low-latency ingestion and optimization for Apache Iceberg
Apache Iceberg Architecture,Large Analytics Tables,Qlik has acquired Upsolver
https://news-cdn.moonbeam.co/Low-latency-ingestion-and-optimization-for-Apache-Iceberg-App-Developer-Magazine_8qpfcx8n.jpg
App Developer Magazine
Low-latency ingestion and optimization for Apache Iceberg

Programming

Low-latency ingestion and optimization for Apache Iceberg


Monday, January 27, 2025

Brittany Hainzinger Brittany Hainzinger

Qlik has acquired Upsolver to enhance its data integration platform with low-latency ingestion and Apache Iceberg optimization. This strengthens Qlik’s end-to-end capabilities, enabling enterprises to unify data, reduce costs, optimize performance, and scale AI-driven insights efficiently.

Qlik announced the acquisition of Upsolver, a pioneer in real-time data streaming and Apache Iceberg optimization. This move deepens Qlik’s ability to provide enterprises with end-to-end, open and scalable solutions that unify data integration, analytics, and AI under a single platform. The acquisition combines Upsolver’s real-time ingestion to Iceberg and adaptive optimization with Qlik’s end-to-end data platform, enabling organizations to access data faster, optimize their data estate, reduce costs, and unlock AI-driven insights. 

Low-latency ingestion and optimization for Apache Iceberg

The acquisition of Upsolver positions Qlik to lead in the shift toward open data lakehouses, where enterprises demand flexibility, scalability, and performance. Apache Iceberg, a transformative open table format, enables organizations to implement open lakehouses that provide high-performance analytics on large datasets while ensuring seamless integration with various data processing engines. By integrating Upsolver’s real-time ingestion and optimization technologies, Qlik offers a seamless platform for delivering timely insights, reducing infrastructure costs, and enabling enterprises to scale analytics and AI initiatives with open, trusted and governed data. 

  • Real-Time Insights: Enable continuous ingestion from streaming sources like Kafka and Kinesis, powering faster decisions and AI workflows. 
  • Unified Data Ecosystem: Single unified data platform to ingest, transform, manage, optimize and govern Iceberg-based open lakehouses. 
  • Cost Optimization: Cut infrastructure costs with Upsolver’s Adaptive Iceberg Optimizer, reducing storage and improving query performance by up to 5x through automated, table-specific optimizations. 
  • Open and Interoperable: Leverage an open Iceberg table format to operate flexibly with a range of tools and engines like Snowflake, Databricks, and Athena.
     

"With Upsolver’s real-time streaming capabilities and advanced Iceberg optimization, we’re building on Qlik’s proven enterprise solutions to drive even greater value for our customers. We’re also excited to welcome Upsolver’s team of experts to Qlik, further strengthening our commitment to providing open, scalable data solutions that reduce complexity and fuel innovation across data integration, analytics, and AI," said James Fisher, Chief Strategy Officer at Qlik. 

"The integration of Qlik and Upsolver highlights the growing importance of open, real-time data architectures in today’s enterprise landscape. This move positions Qlik to deliver solutions that meet the dual demands for scalability and interoperability, helping organizations unlock the full potential of data-intensive workloads such as AI and machine learning while maintaining control over costs and governance," said Stewart Bond, Vice President of Data Intelligence and Integration Software Research at IDC.

"Upsolver and Qlik share a deep commitment to simplifying data complexity and empowering enterprises to unlock the full potential of their data. What makes this partnership so powerful is how seamlessly our real-time ingestion and Iceberg optimization align with Qlik’s end-to-end platform. Together, we are delivering a unified solution that equips organizations to scale with confidence, reduce costs, and enable AI-driven innovation with trusted and governed data," said Ori Rafael, CEO of Upsolver.

The acquisition of Upsolver strengthens Qlik’s ability to address the growing demand for open, real-time data solutions tailored to modern enterprise needs. By integrating Upsolver’s expertise in Iceberg optimization and streaming data with Qlik’s platform, businesses gain the tools to simplify data management, enhance operational efficiency, and scale their AI-driven strategies.


Subscribe to App Developer Magazine

Become a subscriber of App Developer Magazine for just $5.99 a month and take advantage of all these perks.

MEMBERS GET ACCESS TO

  • - Exclusive content from leaders in the industry
  • - Q&A articles from industry leaders
  • - Tips and tricks from the most successful developers weekly
  • - Monthly issues, including all 90+ back-issues since 2012
  • - Event discounts and early-bird signups
  • - Gain insight from top achievers in the app store
  • - Learn what tools to use, what SDK's to use, and more

    Subscribe here