1. https://appdevelopermagazine.com/enterprise
  2. https://appdevelopermagazine.com/streamsets-control-hub-adds-devops-sensibilities/
12/14/2017 10:01:15 AM
StreamSets Control Hub adds DevOps sensibilities
DevOps Dataflow,Data-Driven Platform,Dataflow Management Solution
App Developer Magazine
StreamSets Control Hub adds DevOps sensibilities


StreamSets Control Hub adds DevOps sensibilities

Thursday, December 14, 2017

Christian Hargrave Christian Hargrave

Open source dataflow management solution StreamSets Control Hub helps DevOps teams to manage complex data movements.

StreamSets Inc. has announced immediate availability of StreamSets Control Hub, engineered to streamline the development and operational management of many-to-many dataflows. Available in the Enterprise Edition, StreamSets Control Hub adds DevOps sensibilities to data movement architectures. It offers centralized collaborative design of dataflow topologies and enables testing, provisioning and elastically scalable execution of dataflows anywhere - on premises, on edge or in the cloud - via the open source StreamSets Data Collector (SDC) and recently announced SDC Edge.

StreamSets Control Hub addresses the challenges caused by the evolution of applications toward complex, time-sensitive data movement, where analytics are performed every step of the way. These dataflow architectures demand the same disciplined approach to design and provisioning that enterprises apply to the applications themselves. Traditional hand-coded and ad-hoc approaches to data pipelines slow delivery of data-driven applications, drive up development and maintenance costs, and make application performance fragile when changes occur to the data.

StreamSets Control Hub features include:

  • Hosted dataflow designer for collaborative design of smart pipelines and topologies that can execute anywhere, from edge devices to the data center and across multiple cloud providers

  • Automated deployment and scalable execution of dataflows via Kubernetes today, and other container management methods in the future

  • A development toolkit that provides a programmatic interface for automated build and scalable execution of pipelines, with support for Java and Python

  • Governance integration with enterprise catalogs, starting with Cloudera Navigator and Apache Atlas

  • Flexible hosting options, including via cloud.streamsets.com, private cloud, public cloud and on premises

“We have seen our Fortune 500 customers incur substantial effort and pain as they hand-craft solutions that operationalize their StreamSets dataflow architectures, scaling to hundreds of thousands of pipelines in scope,” said Girish Pancha, CEO of StreamSets. “An operational mindset across the lifecycle is required for modern analytic applications to succeed. We built StreamSets Control Hub to provide a focal point for dataflow management so that businesses can accelerate time to value for their data-driven applications.”

Subscribe to App Developer Magazine

Become a subscriber of App Developer Magazine for just $5.99 a month and take advantage of all these perks.


  • - Exclusive content from leaders in the industry
  • - Q&A articles from industry leaders
  • - Tips and tricks from the most successful developers weekly
  • - Monthly issues, including all 90+ back-issues since 2012
  • - Event discounts and early-bird signups
  • - Gain insight from top achievers in the app store
  • - Learn what tools to use, what SDK's to use, and more

    Subscribe here