Version CloverDX 5.1.1

Common Properties of Readers

  • Readers allow you to specify the location of input data.

    See examples of the File URL attribute for reading from local and remote files, through proxy, input port and dictionary in Supported File URL Formats for Readers.

  • Readers allow you to view the source data. See Viewing Data on Readers.

  • Readers can read data from the input port. E.g. you can read URLs of files to be read. See Input Port Reading.

  • Readers can read only the new records. See Incremental Reading.

  • Readers can skip specific number of initial records or set limit on number of records to be read. See Selecting Input Records.

  • Readers allow you to configure a policy related to parsing incomplete or invalid data record. See Data Policy.

  • Some readers can log information about errors.

  • XML-reading components allow you to configure the parser. See XML Features.

  • In some Readers, a transformation can be or must be defined. For information about transformation templates for transformations written in CTL see:

    CTL Templates for Readers

  • Similarly, for information about transformation interfaces that must be implemented in transformations written in Java see:

    Java Interfaces for Readers

Overview of Readers

Table 55.1. Readers Comparison

ComponentData sourceInput portsOutput portsEach to all outputs[1]Different to different outputs[2]TransformationTransf. req.JavaCTLAuto-propagated metadata
CloverDataReaderCloverDX binary file01-n
yes
no
no
no
no
no
no
ComplexDataReaderflat file11-n
no
yes
yes
yes
yes
yes
no
DataGeneratornone01-n
no
yes
yes
yes
yes
yes
no
DBFDataReaderdBase file0-11-n
yes
no
no
no
no
no
no
DBInputTabledatabase01-n
yes
no
no
no
no
no
no
EmailReaderemail messages01--
yes
no
yes
no
no
FlatFileReaderflat file0-11-2
no
no
no
no
no
no
no
HadoopReaderHadoop sequence file01
no
no
no
no
no
no
no
JavaBeanReaderdictionary01-n
no
yes
no
no
no
no
 
JMSReaderjms messages01--
yes
no
yes
no
no
JSONExtractJSON file0-11-n
no
yes
no
no
no
no
no
JSONReaderJSON file0-11-n
no
yes
no
no
no
no
no
LDAPReaderLDAP directory tree01-n
no
no
no
no
no
no
no
LotusReaderLotus Notes01
no
no
no
no
no
no
no
MongoDBReaderdatabase0-11-2
no
no
yes
yes
no
yes
yes
MultiLevelReaderflat file11-n
no
yes
yes
yes
yes
no
no
ParallelReaderflat file01
no
no
no
no
no
no
yes
QuickBaseRecordReaderQuickBase0-11-2
no
no
no
no
no
no
no
QuickBaseQueryReaderQuickBase01
no
no
no
no
no
no
no
SalesforceBulkReaderSalesforce01
no
no
yes
no
no
yes
no
SalesforceReaderSalesforce01
no
no
yes
no
no
yes
no
SpreadsheetDataReaderXLS(X) file0-11-2
no
no
no
no
no
no
no
UniversalDataReaderflat file0-11-2
no
no
no
no
no
no
no
XMLExtractXML file0-11-n
no
yes
no
no
no
no
no
XMLReaderXML file0-11-n
no
yes
no
no
no
no
no
XMLXPathReaderXML file0-11-n
no
yes
no
no
no
no
no

[1] The component sends each data record to all of the connected output ports.

[2] The component sends different data records to different output ports using return values of the transformation (DataGenerator and MultiLevelReader). For more information, see Return Values of Transformations. XMLExtract, XMLReader and XMLXPathReader send data to ports as defined in their Mapping or Mapping URL attribute.