Data Management Best Practices (Magic xpi 3.x)

The Data Mapper is a very powerful tool, but has an overhead of time and memory. Consider using the Data Mapper only when you need mapping capabilities. For instance:

• Use the Flow Data instead of the Data Mapper to update variables.

• Use the Data Mapper’s Call flow option only when you need to process many records. Use the Invoke Flow if you need to process one record only.

• When you need to store data temporarily, it is more efficient to use a flat file saved in a variable than to use the ODS. The ODS is a table stored in a database and thus consumes more memory than a flat file in memory. However, the ODS is persistent and can be recovered from failure.