IM Relationship Resolution Information Center, Version 4.2

UMF utilities

All incoming data must be transformed into Universal Message Format (UMF) before it can be transported from acquisition programs into the pipelines for processing. The product includes a set of tools to help you with the extract, transform, and load (ETL) process. These UMF utilities reliably transform data into UMF and identify duplicate data and changed records within the data source record set.

You can use the UMF utilities that the product provides, or any other ETL tool that converts the data to UMF.

UMF conversion utilities

The product contains two utilities that help you transform data into UMF:
UMF file conversion utility
This utility transforms flat, fixed-width data source files into UMF. It works in batch mode, which means that the tool processes data as file-in-file-out. You can use the UMF file conversion utility to transform large volumes of data by data source.
UMF database conversion utility
This utility converts data in transactional relational databases into UMF. This tool works in real-time mode, which means that it can receive updates from transactional systems as they occur, transform each record into UMF, and then submit the records for pipeline processing using any supported transport, including HTTP.

Net change utility

The net change utility identifies duplicate data and changed records within the data source, reducing the total volume of data that needs to be transformed and loaded into the system. This utility is useful if one or more of your data sources contain large sets of historical data that is redundant or nearly redundant. The net change utility might help to increase overall system performance by eliminating duplicate record processing and reducing the overall number of records that the pipelines are processing.



Feedback

Last updated: 2009