ParallelSimpleGather
Short Description |
Ports |
Metadata |
Details |
Compatibility |
See also |
Short Description
ParallelSimpleGather gathers data records from multiple CloverDX Cluster workers. The algorithm of the component is derived from the regular SimpleGather component.
Ports
Port type | Number | Required | Description | Metadata |
---|---|---|---|---|
Input | 0 | ✓ | For input data records | Any |
Output | 0 | ✓ | For gathered data records | Input 0 |
Metadata
ParallelSimpleGather propagates metadata in both directions. The component does not change priorities of propagated metadata.
ParallelSimpleGather has no metadata templates.
ParallelSimpleGather does not require any specific metadata fields.
Details
ParallelSimpleGather gathers data records from multiple CloverDX Cluster workers.
The algorithm of this component is derived from the regular SimpleGather component. For more details about attributes and other component specific behavior, see the documentation of the SimpleGather component.
This component belongs to a group of Cluster components that allows the change from a multiple-workers allocation to a single-worker allocation. So the allocation of the component preceding the ParallelSimpleGather component can provide multiple workers. The allocation of the component following the ParallelSimpleGather component has to provide a single worker.
Note | |
---|---|
For more information about this component, see Chapter 42, Data Partitioning in Cluster. |
Compatibility
Version | Compatibility Notice |
---|---|
3.4 | The component is available since 3.4. |
4.3.0-M2 | ClusterSimpleGather was renamed to ParallelSimpleGather. |