Datameer Now Offers Governance for Hadoop Analytics

Posted 6/9/2015 6:01:46 PM by RICHARD HARRIS, Executive Editor

Datameer Now Offers Governance for Hadoop Analytics
Datameer has announced new data governance capabilities for its native Hadoop environment offering an end-to-end big data analytics application for Hadoop designed to make big data accessible. Datameer combines self-service data integration, analytics and visualization functionality.

The platform addresses use cases which are now incorporating sensitive data sets such as PII, PCI and PHI, or require compliance with regulations such as BCBS 239/RDARR, Volcker, HIPAA and others that need quality and consistency, data policies and standards, data security and privacy, regulatory compliance and retention and archiving capabilities.

Datameer’s data profiling tools enable the ability to check and remediate issues like dirty, inconsistent or invalid data at any stage in a complex analytics pipeline, and provides transparency into every change, from the original dataset all the way through to the final visualization. Datameer’s capabilities include data profiling, data statistics monitoring, metadata management and impact analysis. 

Datameer supports secure data views and multi-stage analytics pipelines and provides big data security with LDAP / Active Directory integration, role-based access control, permissions and sharing, integration with Apache Sentry 1.4 and column and row security/anonymization functions.

The platform also supports industries that have legal imperatives for big data governance such as Sarbanes Oxley, Basel, HIPAA and PCI compliance. The platform provides features like data lineage which involve artifact/file level dependency graphs, dependencies REST API and worksheet lineage. Auditing functionality includes user action log and allows external systems to be apprised of user and system audit events as they happen.

In Datameer, flexible retention rules allow each imported data set’s retention policy to be configured by an individual set of rules. Users can keep data permanently, or to purge records that are older than a specific time window. Independent of time, retention rules can also be configured based on the number of runs of ELT ingests or analytics workbook executions.  Security rules allow retired data to be either instantly removed, retained until a specified time, or manually removed after system administrator approval.

The updated platform is available in the Cloud, on premise or both.

Read More


About the author: RICHARD HARRIS, Executive Editor

As the Publisher and Editor for App Developer Magazine, Richard has several industry recognitions and endorsements from tech companies such as Microsoft, Apple and Google for accomplishments in the mobile market. He was part of the early Google AFMA program, and also involved in the foundation of Google TV. He has been developing for mobile since 2003 and serves as CEO of Moonbeam Development, a mobile app company with 200 published titles in various markets throughout the world. Richard is also the founder of LunarAds, a mobile cross-promotion and self-serv mediation network for developers. He has been a featured presenter at trade-shows and conferences, and stays active with new projects relating to mobile development.

Subscribe to App Developer Daily

Latest headlines delivered to you daily.