Big Data
Hazelcast Jet 0.6 promises better processing speeds
Wednesday, April 18, 2018
|
Richard Harris |
Big Data processing engine, Hazelcast Jet, has announced their 0.6v to provide better big data processing speeds, job management, and computation elasticity.
Hazelcast has announced the 0.6 release of Hazelcast Jet - an application embeddable, stream and batch processing engine. New functionality in Hazelcast Jet 0.6 includes a simplified high-level Java API, enhanced job management capabilities which enable computation elasticity and Spring integration.
In its 0.5 release, Hazelcast Jet launched its Pipeline API. In Hazelcast Jet 0.6, the Pipeline API has been expanded to fully cover all Hazelcast Jet features. In 0.6, it is even more straightforward to define sliding, tumbling and session windows or to deal with late events. The API was streamlined to provide convenience for integrating 3rd party libraries such as predictive analytics tools or enrichment, users will find it easy to write a custom sink to output data to any system of record. Stream processing has overtaken batch processing as the preferred method of processing big data sets and these new features are designed to satisfy the needs of companies that require immediate insight into their data.
The new elasticity features of Hazelcast Jet 0.6 allow for elastic scale out and scale in, perfect for the cloud. Executing jobs can be rescaled to make use of new nodes as they added - meaning running production jobs will scale to utilize computational resources as and when it’s made available, even while in mid-production. When a node is removed, computations are resized to the smaller cluster without interruption.
Anyone who is a Java 8 programmer will find it very natural and simple. To accommodate the large audience of Spring users, Spring integrations are added. In Hazelcast Jet 0.6, a Jet client or Jet instance can be configured as a Spring Bean and developers are now able to autowire them with their applications. Also, the Spring Context of the Jet cluster can be injected directly into a Jet job.
Greg Luck, CEO of Hazelcast, said: “Jet is being adopted rapidly by the Global 200. The deployment and programming simplicity, its embeddability, and the validated performance advantage of Jet are driving this. Hazelcast Jet 0.6 gains valuable features for even broader deployment.”
In its 0.5 release, Hazelcast Jet launched its Pipeline API. In Hazelcast Jet 0.6, the Pipeline API has been expanded to fully cover all Hazelcast Jet features. In 0.6, it is even more straightforward to define sliding, tumbling and session windows or to deal with late events. The API was streamlined to provide convenience for integrating 3rd party libraries such as predictive analytics tools or enrichment, users will find it easy to write a custom sink to output data to any system of record. Stream processing has overtaken batch processing as the preferred method of processing big data sets and these new features are designed to satisfy the needs of companies that require immediate insight into their data.
The new elasticity features of Hazelcast Jet 0.6 allow for elastic scale out and scale in, perfect for the cloud. Executing jobs can be rescaled to make use of new nodes as they added - meaning running production jobs will scale to utilize computational resources as and when it’s made available, even while in mid-production. When a node is removed, computations are resized to the smaller cluster without interruption.
Anyone who is a Java 8 programmer will find it very natural and simple. To accommodate the large audience of Spring users, Spring integrations are added. In Hazelcast Jet 0.6, a Jet client or Jet instance can be configured as a Spring Bean and developers are now able to autowire them with their applications. Also, the Spring Context of the Jet cluster can be injected directly into a Jet job.
Additional enhancements in Hazelcast Jet 0.6 include:
- Updated Hazelcast Jet connectors: Kafka v1.0 and HDFS v2.8.3
- Embedded Hazelcast IMDG updated to v3.10
- Entry Processor Sink: when writing to IMap, Hazelcast IMDG users can now update just a part of the entry instead of rewriting the complete entry.
- Java 9: Hazelcast Jet builds and runs on Java 9 and supports the new Java module system.
Greg Luck, CEO of Hazelcast, said: “Jet is being adopted rapidly by the Global 200. The deployment and programming simplicity, its embeddability, and the validated performance advantage of Jet are driving this. Hazelcast Jet 0.6 gains valuable features for even broader deployment.”
Become a subscriber of App Developer Magazine for just $5.99 a month and take advantage of all these perks.
MEMBERS GET ACCESS TO
- - Exclusive content from leaders in the industry
- - Q&A articles from industry leaders
- - Tips and tricks from the most successful developers weekly
- - Monthly issues, including all 90+ back-issues since 2012
- - Event discounts and early-bird signups
- - Gain insight from top achievers in the app store
- - Learn what tools to use, what SDK's to use, and more
Subscribe here
