Datameer has announced new data governance capabilities for its native Hadoop environment offering an end-to-end big data analytics application for Hadoop designed to make big data accessible. Datameer combines self-service data integration, analytics and visualization functionality.
The platform addresses use cases which are now incorporating sensitive data sets such as PII, PCI and PHI, or require compliance with regulations such as BCBS 239/RDARR, Volcker, HIPAA and others that need quality and consistency, data policies and standards, data security and privacy, regulatory compliance and retention and archiving capabilities.
Datameer’s data profiling tools enable the ability to check and remediate issues like dirty, inconsistent or invalid data at any stage in a complex analytics pipeline, and provides transparency into every change, from the original dataset all the way through to the final visualization. Datameer’s capabilities include data profiling, data statistics monitoring, metadata management and impact analysis.
Datameer supports secure data views and multi-stage analytics pipelines and provides big data security with LDAP / Active Directory integration, role-based access control, permissions and sharing, integration with Apache Sentry 1.4 and column and row security/anonymization functions.
The platform also supports industries that have legal imperatives for big data governance such as Sarbanes Oxley, Basel, HIPAA and PCI compliance. The platform provides features like data lineage which involve artifact/file level dependency graphs, dependencies REST API and worksheet lineage. Auditing functionality includes user action log and allows external systems to be apprised of user and system audit events as they happen.
In Datameer, flexible retention rules allow each imported data set’s retention policy to be configured by an individual set of rules. Users can keep data permanently, or to purge records that are older than a specific time window. Independent of time, retention rules can also be configured based on the number of runs of ELT ingests or analytics workbook executions. Security rules allow retired data to be either instantly removed, retained until a specified time, or manually removed after system administrator approval.
The updated platform is available in the Cloud, on premise or both.