1. https://appdevelopermagazine.com/iot
  2. https://appdevelopermagazine.com/iot-security-gets-tighter-thanks-to-sdc-edge/
12/5/2017 2:23:09 PM
IoT security gets tighter thanks to SDC Edge
IoT Cybersecurity Solution,IoT Device Security,End-to-End Security
App Developer Magazine
IoT security gets tighter thanks to SDC Edge


IoT security gets tighter thanks to SDC Edge

Tuesday, December 5, 2017

Christian Hargrave Christian Hargrave

IoT Security solution developed by StreamSets is allowing developers to implement end-to-end data security.

StreamSets Inc. has debuted StreamSets Data Collector Edge (SDC Edge), an end-to-end data ingestion solution for resource and connectivity constrained systems such as Internet of Things (IoT) devices and the network infrastructure and personal devices that inform cybersecurity applications.

SDC Edge packs the core functionality of the widely adopted StreamSets Data Collector into a footprint of less than 5MB. Dataflows are difficult to maintain as devices are upgraded, are poorly instrumented for operational dataflow management, and often require a gateway that adds cost, complexity and latency. The benefits of a small footprint also apply to cybersecurity initiatives, where its low CPU consumption and limited attack surface allow deployment of SDC Edge across large populations of mobile endpoints and networking systems.

Key characteristics of SDC Edge include:

  • Ultralight: Requires less than 5MB and does not need additional software (e.g. Java) to operate.

  • Platform-independent: Based on Go, SDC Edge runs on a broad range of operating systems, including Linux, OS X, Windows and Android.

  • Drag-and-drop dataflow design: Identical to StreamSets Data Collector, pipelines are built using origin, destination and transformation objects, with the option to plug in scripts and trigger custom code execution.

  • Edge analytics: SDC Edge performs computations such as data normalization, redaction and aggregation, and is architected to support full-featured edge analytics, including machine and deep-learning models.

  • Multiple bidirectional pipelines: SDC Edge can run multiple pipelines on the same edge device, and pipelines can both send or receive data.

  • No IoT gateway cost: Data can now be ingested directly to storage/compute systems without the added cost, complexity and latency of a separate IoT gateway system.

  • Performance management: Using StreamSets Dataflow Performance Manager, SDC Edge can be deployed at scale, and metadata drives Live Data Map visualization and enforcement of source-to-consumption data SLAs.

IoT and cybersecurity are both red-hot spaces for big data innovation. Applying machine learning and other analytic techniques to data aggregated from IoT sensors and devices can help in areas as diverse as factory equipment, construction, oil and gas, and medical devices. Cybersecurity applications benefit from applying advanced analytics to the vast quantities of data collected across a corporate network in order to detect imminent threats or attacks in progress.

“The massive volume of data created by the explosion of digital devices presents an invaluable opportunity for analytics and insight. However, harnessing this data for important efforts such as IoT and cybersecurity has been a challenge due to the lack of end-to-end data ingestion frameworks,” said Arvind Prabhakar, co-founder and CTO, StreamSets. “We built SDC Edge to bring disciplined, well-managed data movement to huge populations of IoT sensors and personal devices so that the promised benefits of these critical initiatives are realized.”

Subscribe to App Developer Magazine

Become a subscriber of App Developer Magazine for just $5.99 a month and take advantage of all these perks.


  • - Exclusive content from leaders in the industry
  • - Q&A articles from industry leaders
  • - Tips and tricks from the most successful developers weekly
  • - Monthly issues, including all 90+ back-issues since 2012
  • - Event discounts and early-bird signups
  • - Gain insight from top achievers in the app store
  • - Learn what tools to use, what SDK's to use, and more

    Subscribe here