Version
ParallelSimpleGather
Short description
ParallelSimpleGather gathers data records from multiple CloverDX Cluster workers. The algorithm of the component is derived from the regular SimpleGather component.
| Same input metadata | Sorted inputs | Inputs | Outputs | Java | CTL | Auto-propagated metadata |
|---|---|---|---|---|---|---|
✓ |
⨯ |
1[1] |
1 |
⨯ |
⨯ |
✓ |
Ports
| Port type | Number | Required | Description | Metadata |
|---|---|---|---|---|
Input |
0 |
✓ |
For input data records |
Any |
Output |
0 |
✓ |
For gathered data records |
Input 0 |
Metadata
ParallelSimpleGather propagates metadata in both directions. The component does not change priorities of propagated metadata.
ParallelSimpleGather has no metadata templates.
ParallelSimpleGather does not require any specific metadata fields.
Details
ParallelSimpleGather gathers data records from multiple CloverDX Cluster workers.
The algorithm of this component is derived from the regular SimpleGather component. For more details about attributes and other component specific behavior, see the documentation of the SimpleGather component.
This component belongs to a group of Cluster components that allows the change from a multiple-workers allocation to a single-worker allocation. So the allocation of the component preceding the ParallelSimpleGather component can provide multiple workers. The allocation of the component following the ParallelSimpleGather component has to provide a single worker.
|
For more information about this component, see Data partitioning in cluster. |
Compatibility
| Version | Compatibility Notice |
|---|---|
3.4 |
The component is available since 3.4. |
4.3.0-M2 |
ClusterSimpleGather was renamed to ParallelSimpleGather. |