Best Data Management Software for IRI NextForm

IRI FieldShield® is a powerful and affordable data discovery and de-identification package for masking PII, PHI, PAN and other sensitive data in structured and semi-structured sources. Front-ended in a free Eclipse-based design environment, FieldShield jobs classify, profile, scan, and de-identify data at rest (static masking). Use the FieldShield SDK or proxy-based application to secure data in motion (dynamic data masking). The usual method for masking RDB and other flat files (CSV, Excel, LDIF, COBOL, etc.) is to classify it centrally, search for it globally, and automatically mask it in a consistent way using encryption, pseudonymization, redaction or other functions to preserve realism and referential integrity in production or test environments. Use FieldShield to make test data, nullify breaches, or comply with GDPR. HIPAA. PCI, PDPA, PCI-DSS and other laws. Audit through machine- and human-readable search reports, job logs and re-ID risks scores. Optionally mask data when you map it; FieldShield functions can also run in IRI Voracity ETL and federation, migration, replication, subsetting, and analytic jobs. To mask DB clones run FieldShield in Windocks, Actifio or Commvault. Call it from CI/CD pipelines and apps.

For more four decades, IRI CoSort has defined the state-of-the-art in big data sorting and transformation technology. From advanced algorithms to automatic memory management, and from multi-core exploitation to I/O optimization, there is no more proven performer for production data processing than CoSort. CoSort was the first commercial sort package developed for open systems: CP/M in 1980, MS-DOS in 1982, Unix in 1985, and Windows in 1995. Repeatedly reported to be the fastest commercial-grade sort product for Unix. CoSort was also judged by PC Week to be the "top performing" sort on Windows. CoSort was released for CP/M in 1978, DOS in 1980, Unix in the mid-eighties, and Windows in the early nineties, and received a readership award from DM Review magazine in 2000. CoSort was first designed as a file sorting utility, and added interfaces to replace or convert sort program parameters used in IBM DataStage, Informatica, MF COBOL, JCL, NATURAL, SAS, and SyncSort. In 1992, CoSort added related manipulation functions through a control language interface based on VMS sort utility syntax, which evolved through the years to handle structured data integration and staging for flat files and RDBs, and multiple spinoff products.

IRI RowGen generates rows ... billions of rows of safe, intelligent test data in database, flat-file, and formatted report targets ... using metadata, not data. RowGen synthesizes and populates accurate, relational test data with the same characteristics of production data. RowGen uses the metadata you already have (or create on the fly) to randomly generate structurally and referentially correct test data, and/or randomly select data from real sets. RowGen lets you customize data formats, volumes, ranges, distributions, and other properties on the fly or with re-usable rules that support major goals like application testing and subsetting. RowGen uses the IRI CoSort engine to deliver the fastest generation, transformation, and bulk-load movement of big test data on the market. RowGen was designed by data modeling, integration, and processing experts to save time and energy in the creation of perfect, compliant test sets in production and custom formats. With RowGen, you can produce and provision safe, smart, synthetic test data for: DevOps, DB, DV, and DW prototypes, demonstrations, application stress-testing, and benchmarking -- all without needing production data.

The IRI Data Manager suite from IRI, The CoSort Company, provides all the tools you need to speed up data manipulation and movement. IRI CoSort handles big data processing tasks like DW ETL and BI/analytics. It also supports DB loads, sort/merge utility migrations (downsizing), and other data processing heavy lifts. IRI Fast Extract (FACT) is the only tool that you need to unload large databases quickly (VLDB) for DW ETL, reorg, and archival. IRI NextForm speeds up file and table migrations, and also supports data replication, data reformatting, and data federation. IRI RowGen generates referentially and structurally correct test data in files, tables, and reports, and also includes DB subsetting (and masking) capabilities for test environments. All of these products can be licensed standalone for perpetual use, share a common Eclipse job design IDE, and are also supported in IRI Voracity (data management platform) subscriptions.

IRI Voracity is an end-to-end software platform for fast, affordable, and ergonomic data lifecycle management. Voracity speeds, consolidates, and often combines the key activities of data discovery, integration, migration, governance, and analytics in a single pane of glass, built on Eclipse™. Through its revolutionary convergence of capability and its wide range of job design and runtime options, Voracity bends the multi-tool cost, difficulty, and risk curves away from megavendor ETL packages, disjointed Apache projects, and specialized software. Voracity uniquely delivers the ability to perform data: * profiling and classification * searching and risk-scoring * integration and federation * migration and replication * cleansing and enrichment * validation and unification * masking and encryption * reporting and wrangling * subsetting and testing Voracity runs on-premise, or in the cloud, on physical or virtual machines, and its runtimes can also be containerized or called from real-time applications or batch jobs.

A fast extract step can be a critical component of: database archive and replication database reorgs and migrations data warehouse ETL, ELT, and ODS operations offline reporting and bulk data protection IRI Fast Extract (FACT™) is a parallel unload utility for very large database (VLDB) tables in: Oracle DB2 UDB MS SQL Server Sybase MySQL Greenplum Teradata Altibase Tibero FACT uses simple job scripts (supported in a familiar Eclipse GUI) to rapidly create portable flat files. FACT's speed comes from native connection protocols and proprietary split query logic that unloads billions of rows in minutes. Although FACT is a standalone, application-independent utility, it can also work nicely with other programs and platforms. For example, FACT optionally creates metadata for data definition files (.DDF) that IRI CoSort and its compatible data management and protection tools can use to manipulate the flat files. FACT also automatically creates database load utility configuration files for the same source. FACT is also an optional, seamlessly integrated component in the IRI Voracity ETL and data management platform. The automatic metadata creation -- and coexistence of other IRI software in the same IDE --