Processing Lists

After importing a list (defined in the Creating Lists topic here), users can:

See the Processing Example topic (here) and the Processing Example Including External Processing Operation topic (here) for an explanation of each step of this functionality.

After processing a list, continue by exporting the list as defined in the Exporting a Processed List topic here.

Prerequisites

This topic assumes that users have already created the object types required for list processing, performed the required workbench configurations, and Web UI screen setup. For more information on the required setup for processing lists, see the List Processing topic here.

To execute list processing, users must be part of a user group with the 'Run List Processing' user action. For information on adding user actions, see the Maintaining Action topic in the System Setup / Super User Guide documentation here.

List Processing Summary Card

The summary card is displayed at the top of the screen and shows basic information about the list (as shown in the image above):

The information on this card cannot be modified. For more information, see the Configuring List Processing in Web UI topic here.

Profile Findings

The 'Profile Findings' button displays a configured data profile screen. As a list is imported or processed, a new data profile is generated based on the default profile configuration setting on the object type of the list.

In this screen users can scrutinize the quality of the data in the list immediately after import and after every processing has updated the list data. For list object type data, attribute advanced search capabilities are disabled on the Data Profile Screen. Additionally, when refreshing the data profile for a list you cannot select a different profile configuration. For more information, see the Data Profiling in Web UI topic (here) and Profile Configuration topic in the Data Profiling documentation (here).

Process List

The 'Process list' dropdown displays all list processing configurations that are valid for the object type of the list. For more information, see the Configuring List Processing Workbench topic in this documentation here.

Processing a list is managed by a background process (BGP). Errors and warnings can occur during processing of the list and the list processing BGP can therefore complete in any of the following states for the following reasons.

Files used by list processing are compressed to reduce the disk space consumed, including:

When using external processing, the Suspended status indicates that the list has not yet been received from the external processing service. For details, see the Processing Example topic (here) and the Processing Example Including External Processing Operation topic (here).

Processing BGP Statuses

Note: Some operations are executed in parallel to optimize performance, but all operations are applied in the configured order per record. Use the following case-sensitive sharedconfig.properties file parameter to set the number of parallel processes that can execute list processing (e.g., 20):

BackgroundProcess.Queue.LIST_PROCESSING_QUEUE.Parallel=20