Version

    Common Properties of Readers

    • Readers allow you to specify the location of input data.

      See examples of the File URL attribute for reading from local and remote files, through proxy, input port and dictionary in Supported File URL Formats for Readers.

    • Readers allow you to view the source data. See Viewing Data on Readers.

    • Readers can read data from the input port. E.g. you can read URLs of files to be read. See Input Port Reading.

    • Readers can read only the new records. See Incremental Reading.

    • Readers can skip specific number of initial records or set limit on number of records to be read. See Selecting Input Records.

    • Readers allow you to configure a policy related to parsing incomplete or invalid data record. See Data Policy.

    • Some readers can log information about errors.

    • XML-reading components allow you to configure the parser. See XML Features.

    • In some Readers, a transformation can be or must be defined. For information about transformation templates for transformations written in CTL see:

      CTL Templates for Readers

    • Similarly, for information about transformation interfaces that must be implemented in transformations written in Java see:

      Java Interfaces for Readers

    Overview of Readers

    Table 54.1. Readers Comparison

    ComponentData sourceInput portsOutput portsEach to all outputs[1]Different to different outputs[2]TransformationTransf. req.JavaCTLAuto-propagated metadata
    CloverDataReaderCloverDX binary file01-n
    yes
    no
    no
    no
    no
    no
    no
    ComplexDataReaderflat file11-n
    no
    yes
    yes
    yes
    yes
    yes
    no
    DatabaseReaderdatabase01-n
    yes
    no
    no
    no
    no
    no
    no
    DataGeneratornone01-n
    no
    yes
    yes
    yes
    yes
    yes
    no
    DBFDataReaderdBase file0-11-n
    yes
    no
    no
    no
    no
    no
    no
    EmailReaderemail messages01--
    yes
    no
    yes
    no
    no
    FlatFileReaderflat file0-11-2
    no
    no
    no
    no
    no
    no
    no
    HadoopReaderHadoop sequence file01
    no
    no
    no
    no
    no
    no
    no
    JavaBeanReaderdictionary01-n
    no
    yes
    no
    no
    no
    no
    		 
    JMSReaderjms messages01--
    yes
    no
    yes
    no
    no
    JSONExtractJSON file0-11-n
    no
    yes
    no
    no
    no
    no
    no
    JSONReaderJSON file0-11-n
    no
    yes
    no
    no
    no
    no
    no
    LDAPReaderLDAP directory tree01-n
    no
    no
    no
    no
    no
    no
    no
    MongoDBReaderdatabase0-11-2
    no
    no
    yes
    yes
    no
    yes
    yes
    MultiLevelReaderflat file11-n
    no
    yes
    yes
    yes
    yes
    no
    no
    ParallelReaderflat file01
    no
    no
    no
    no
    no
    no
    yes
    QuickBaseRecordReaderQuickBase0-11-2
    no
    no
    no
    no
    no
    no
    no
    QuickBaseQueryReaderQuickBase01
    no
    no
    no
    no
    no
    no
    no
    SalesforceBulkReaderSalesforce01
    no
    no
    yes
    no
    no
    yes
    no
    SalesforceReaderSalesforce01
    no
    no
    yes
    no
    no
    yes
    no
    SpreadsheetDataReaderXLS(X) file0-11-2
    no
    no
    no
    no
    no
    no
    no
    UniversalDataReaderflat file0-11-2
    no
    no
    no
    no
    no
    no
    no
    XMLExtractXML file0-11-n
    no
    yes
    no
    no
    no
    no
    no
    XMLReaderXML file0-11-n
    no
    yes
    no
    no
    no
    no
    no
    XMLXPathReaderXML file0-11-n
    no
    yes
    no
    no
    no
    no
    no

    [1] The component sends each data record to all of the connected output ports.

    [2] The component sends different data records to different output ports using return values of the transformation (DataGenerator and MultiLevelReader). For more information, see Return Values of Transformations. XMLExtract, XMLReader and XMLXPathReader send data to ports as defined in their Mapping or Mapping URL attribute.