Common Properties of Readers
-
Readers allow you to specify the location of input data.
See examples of the File URL attribute for reading from local and remote files, through proxy, input port and dictionary in Supported File URL Formats for Readers.
-
Readers allow you to view the source data. See Viewing Data on Readers.
-
Readers can read data from the input port. E.g. you can read URLs of files to be read. See Input Port Reading.
-
Readers can read only the new records. See Incremental Reading.
-
Readers can skip specific number of initial records or set limit on number of records to be read. See Selecting Input Records.
-
Readers allow you to configure a policy related to parsing incomplete or invalid data record. See Data Policy.
-
Some readers can log information about errors.
-
XML-reading components allow you to configure the parser. See XML Features.
-
In some Readers, a transformation can be or must be defined. For information about transformation templates for transformations written in CTL see:
-
Similarly, for information about transformation interfaces that must be implemented in transformations written in Java see:
Overview of Readers
| Component | Data source | Input ports | Output ports | Each to all outputs[1] | Different to different outputs[2] | Transformation | Transf. req. | Java | CTL | Auto-propagated metadata |
|---|---|---|---|---|---|---|---|---|---|---|
CloverDX binary file |
0 |
1-n |
✓ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
flat file |
1 |
1-n |
⨯ |
✓ |
✓ |
✓ |
✓ |
✓ |
⨯ |
|
database |
0 |
1-n |
✓ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
none |
0 |
1-n |
⨯ |
✓ |
✓ |
✓ |
✓ |
✓ |
⨯ |
|
dBase file |
0-1 |
1-n |
✓ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
EDIFACT files |
0-1 |
1-n |
⨯ |
✓ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
email messages |
0 |
1 |
- |
- |
✓ |
⨯ |
✓ |
⨯ |
⨯ |
|
flat file |
0-1 |
1-2 |
⨯ |
✓ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
Hadoop sequence file |
0 |
1 |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
dictionary |
0 |
1-n |
⨯ |
✓ |
⨯ |
⨯ |
⨯ |
⨯ |
||
jms messages |
0 |
1 |
- |
- |
✓ |
⨯ |
✓ |
⨯ |
⨯ |
|
JSON file |
0-1 |
1-n |
⨯ |
✓ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
JSON file |
0-1 |
1-n |
⨯ |
✓ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
0-1 |
0 |
⨯ |
⨯ |
✓ |
⨯ |
⨯ |
✓ |
⨯ |
||
Kafka cluster |
0 |
1 |
⨯ |
⨯ |
✓ |
⨯ |
⨯ |
✓ |
⨯ |
|
LDAP directory tree |
0 |
1-n |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
database |
0-1 |
1-2 |
⨯ |
⨯ |
✓ |
✓ |
⨯ |
✓ |
✓ |
|
flat file |
1 |
1-n |
⨯ |
✓ |
✓ |
✓ |
✓ |
⨯ |
⨯ |
|
flat file |
0 |
1 |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
✓ |
|
Parquet file |
0-1 |
1-2 |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
✓ |
|
QuickBase |
0-1 |
1-2 |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
QuickBase |
0 |
1 |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
Salesforce |
0 |
1 |
⨯ |
⨯ |
✓ |
⨯ |
⨯ |
✓ |
⨯ |
|
Salesforce |
0 |
1 |
⨯ |
⨯ |
✓ |
⨯ |
⨯ |
✓ |
⨯ |
|
XLS(X) file |
0-1 |
1-2 |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
flat file |
0-1 |
1-2 |
⨯ |
✓ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
X12 files |
0-1 |
1-n |
⨯ |
✓ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
XML file |
0-1 |
1-n |
⨯ |
✓ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
XML file |
0-1 |
1-n |
⨯ |
✓ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
|
XML file |
0-1 |
1-n |
⨯ |
✓ |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
| 2 |
The component sends different data records to different output ports using return values of the transformation (DataGenerator and MultiLevelReader). For more information, see Return Values of Transformations. XMLExtract, XMLReader and XMLXPathReader send data to ports as defined in their Mapping or Mapping URL attribute. |