Background Process Queue Recommendations
This is one of the data gathering methodologies and recommendations for functional performance improvement. The full list is defined in the Functional Performance Recommendations topic here.
Configuration properties allow admin users to manage system behavior for a wide range of functionality, for example, the management of background processes and web services.
Important: Ensure changes in the settings are applied with care and properly tested before promoting to production. Parallel setting and multi-threading can easily result in optimistic locking issues, which can have a negative impact on performance, rather than the desired performance gain.
Parallel and multi-threading optimizations can be applied to background process (BGP) queues used by integration endpoints, event processors, and scheduled processes.
To determine the background process type and the queue handling the process, in workbench, on the BG Processes tab, click the all users button (
), select a node, open the Process Type Information flipper, and find the 'Process Type ID' parameter.
Recommendations
The following recommendations apply to specific types of BGP.
-
Long-running integration endpoints: use the 'Queue for the endpoint process' parameter, the queue size, the 'Transactional settings' parameter, and CPU cores as appropriate to limit optimistic locking issues.
-
Event processors: use the queue size and CPU cores as appropriate to limit optimistic locking issues.
-
Scheduled processes (types include BulkUpdate, Exporter, etc., and others like AsyncJobRunner): use the queue size, the 'Transactional settings' parameter, queue parallel, and CPU cores as appropriate to limit optimistic and pessimistic locking issues.
Review the topics below for information on running parallel and multi-threading processes.
In the System Setup / Super User Guide documentation:
-
Background Processes and Queues (here) - for explanations and examples of parallel and multi-threading properties
-
Default Configuration for Background Process Queues (here) - for standard configuration settings
-
Modifying Background Process Queue Configuration (here) - for instructions on updating queue settings to use parallel and multithreading
In the System Administration documentation:
-
Event Processor and Event Queue Recommendations (here) - for instructions on managing queues and queue size
-
Import Elements to Use (here) - for information about using separate queues for important IIEPs
-
Export Elements to Use (here) - for information about multi-threading and using separate queues for important IIEPs
In the Data Exchange documentation:
-
Integration Endpoint Transactional Settings (here) - for information about managing the data processing order