All incoming data must be transformed into Universal Message Format (UMF) before it can be transported from acquisition programs into the pipelines for processing. The product includes a set of tools to help you with the extract, transform, and load (ETL) process. These UMF utilities reliably transform data into UMF and identify duplicate data and changed records within the data source record set.
You can use the UMF utilities that the product provides, or any other ETL tool that converts the data to UMF.
The net change utility identifies duplicate data and changed records within the data source, reducing the total volume of data that needs to be transformed and loaded into the system. This utility is useful if one or more of your data sources contain large sets of historical data that is redundant or nearly redundant. The net change utility might help to increase overall system performance by eliminating duplicate record processing and reducing the overall number of records that the pipelines are processing.