Confluent's Platform Receives Updated Apache Kafka 0.9 Core

Posted 12/11/2015 3:07:43 PM by RICHARD HARRIS, Executive Editor

Confluent has released an update to its open source Confluent Platform 2.0 which is based on an updated Apache Kafka 0.9 core. The release offers new functionality to enable secure multi-tenant operations, simplify development and maintenance of applications that produce or consume data in Kafka, and provide high-throughput, scalable data integration with a wide array of data sources. The platform turns an organization’s data into readily available low-latency streams, and acts as a buffer between systems that might produce or consume such data at different rates. 

The Confluent Platform is built upon Apache Kafkato provide a central stream data pipeline. Kafka is an open source system for managing real-time streams of data from websites, applications and sensors. Apache Kafka includes pure Java clients (both producers and consumers) that developers can integrate into Java applications or other languages that run on the JVM, including Scala, Clojure, JRuby, and Jython.

Confluent provides client tools for a variety of languages, including Java, C, C++, and allow messages to be produced or consumed with any network connected tool using the company’s REST proxy. Confluent includes a schema registry to help assure data consistency across multiple applications and organizations as well as providing a set of connectors for common sources like databases, files, and Hadoop that make it easy to read data into Kafka, or write data from Kafka.

With Kafka, developers can build a centralized data pipeline enabling microservices or enterprise data integration, such as high-capacity ingestion routes for Apache Hadoop or traditional data warehouses, or as a foundation for advanced stream processing using engines like Apache Spark, Storm or Samza. 

Part of this latest release is Kafka Connect, a new connector-driven data integration feature that facilitates large-scale, real-time data import and export for Kafka, enabling developers to integrate various data sources with Kafka without writing code through a 24/7 production environment which includes automatic fault-tolerance, transparent, high-capacity scale-out, and centralized management.

Other new Confluent Platform 2.0 features include:

- Data Encryption: Ensures encryption over the wire using SSL.

- Authentication and Authorization: Allows access control with permissions that can be set on a per-user or per-application basis.

- Quality of Service: Configurable quotas that allow throttling of reads and writes to ensure quality of service.

- New Java consumer: The update includes a new Java consumer simplifying the development, deployment, scalability, and maintenance of consumer applications using Kafka.

- Supported C client: Fully featured producer and consumer implementation.

- Over 500 individual performance, operational, and management improvements.
manufacturer coupons for prescription drugs pharmacy discount coupon manufacturer coupons for prescription drugs

Read More


About the author: RICHARD HARRIS, Executive Editor

As the Publisher and Editor for App Developer Magazine, Richard has several industry recognitions and endorsements from tech companies such as Microsoft, Apple and Google for accomplishments in the mobile market. He was part of the early Google AFMA program, and also involved in the foundation of Google TV. He has been developing for mobile since 2003 and serves as CEO of Moonbeam Development, a mobile app company with 200 published titles in various markets throughout the world. Richard is also the founder of LunarAds, a mobile cross-promotion and self-serv mediation network for developers. He has been a featured presenter at trade-shows and conferences, and stays active with new projects relating to mobile development.

Subscribe to App Developer Daily

Latest headlines delivered to you daily.