ParallelMerge

ClusterGather 64x64

Short description

Ports

Metadata

Details

Compatibility

See also

Short description

ParallelMerge gathers data records from multiple CloverDX Cluster workers. The algorithm of the component is derived from the regular Merge component.

Same input metadata Sorted inputs Inputs Outputs Java CTL Auto-propagated metadata

1[1]

1

1

 The single input port represents multiple virtual input ports.

Ports

Port type Number Required Description Metadata

Input

0

For input data records

Any

Output

0

For gathered data records

Input 0

Metadata

ParallelMerge propagates metadata in both directions. The component does not change metadata priorities.

The component has no metadata template.

The component does not require any specific metadata fields on its ports.

ParallelMerge attributes

ParallelMerge has same attributes as Merge. See Merge attributes.

Details

ParallelMerge gathers data records from multiple CloverDX Cluster workers.

The algorithm of this component is derived from the regular Merge component. For more details about attributes and other component specific behavior, see the Merge component.

This component belongs to a group of Cluster components that allows the change from a multiple-workers allocation to a single-worker allocation. So the allocation of the component preceding the ParallelMerge component can provide multiple workers. The allocation of the component following the ParallelMerge component has to provide a single worker.

For more information about this component, see Data partitioning in cluster.

Compatibility

Version Compatibility Notice

3.4

The component is available since version 3.4.

4.3.0-M2

ClusterMerge was renamed to ParallelMerge.