Version CloverDX 6.7.0
InformixBulkWriter
Short description
InformixBulkWriter loads data into an Informix database.
|
When to use InformixBulkWriter
This component requires installation and configuration of a database native client. The client must be installed on the same machine as CloverDX Server (when working in a server project) or CloverDX Designer (when working in a local project). Due to this overhead, we recommend using this component only if you require significantly higher loading performance than with DatabaseWriter which should be used in typical scenarios. |
| Data output | Input ports | Output ports | Transformation | Transf. required | Java | CTL | Auto-propagated metadata |
|---|---|---|---|---|---|---|---|
database |
0-1 |
0-1 |
⨯ |
⨯ |
⨯ |
⨯ |
⨯ |
Ports
| Port type | Number | Required | Description | Metadata |
|---|---|---|---|---|
Input |
0 |
Records to be loaded into the database |
Any |
|
Output |
0 |
⨯ |
For information about incorrect records. |
Input 0 (plus two Error fields for InformixBulkWriter[2]) |
Metadata
InformixBulkWriter does not propagate metadata.
Metadata on the output port 0 contains two additional fields at their end: number of row, error message.
| Field number | Field name | Data type | Description |
|---|---|---|---|
LastInputField + 1 |
<anyname1> |
integer |
The number of the row. |
LastInputField + 2 |
<anyname2> |
string |
The error message. |
InformixBulkWriter attributes
| Attribute | Req | Description | Possible values |
|---|---|---|---|
Basic |
|||
The path to the dbload utility. |
yes |
The name of the dbload utility, including the path. The Informix server must be installed and configured on the same machine where CloverDX runs and the user must be logged in as root. The dbload command line tool must be available. |
|
Host |
The host where the database server is located. |
||
Database |
yes |
The name of the database into which the records should be loaded. |
|
Database table |
yes |
The name of the database table into which the records should be loaded. |
|
Advanced |
|||
Control script |
The control script to be used by the dbload utility.
If it is not set, the default control script is used instead.
Is used only if the Use load utility attribute is set to |
||
Error log URL |
The name of the error log file, including the path. If not set, the default error log file is used instead. |
./error.log |
|
Max error count |
The maximum number of allowed records. When this number is exceeded, the graph fails. |
10 (default) | 0-N |
|
Ignore rows |
The number of rows to be skipped.
Used only if the Use load utility attribute is set to |
0 (default) | 1-N |
|
Commit interval |
Commit interval in number of rows. |
100 (default) | 1-N |
|
Column delimiter |
One character delimiter used for each column in data.
Field values must not include this delimiter as their part.
Used only if the Use load utility attribute is set to |
"|" (default) | other character |
|
Loader input file |
The name of the input file to be loaded, including the path.
Normally, this file is a temporary storage for data to be passed to the dbload utility unless |
||
Deprecated |
|||
Use load utility |
By default, the dbload utility is used to load data to the database.
If set to |
false (default) | true |
|
User name |
The username to be used when connecting to the database.
Used only if the Use load utility attribute is set to |
||
Password |
The password to be used when connecting to the database.
The password is used only if the Use load utility attribute is set to |
||
Ignore unique key violation |
By default, unique key violation is not ignored.
If key values are not unique, the graph fails.
If set to |
false (default) | true |
|
Use insert cursor |
By default, the insert cursor is used.
Using the insert cursor doubles the transfer performance.
Used only if the Use load utility attribute is set to |
true (default) | false |
|
Details
InformixBulkWriter loads data into a database using the Informix database client (dbload utility) or the load2 free library.
It is very important to have the server with the database on the same computer as both the dbload database utility and CloverDX; furthermore, you must be logged in as the root user.
The Informix server must be installed and configured on the same machine where CloverDX runs and the user must be logged in as root.
The Dbload command line tool must also be available.
InformixBulkWriter reads data from the input port or a file. If the input port is not connected to any other component, data must be contained in a file that should be specified in the component.
If you connect a component to the optional output port, rejected records along with information about errors are sent to it.
Another tool is the load2 free library instead of the dbload utility.
The load2 free library can be used even if the server is located on a remote computer.
Loader input file
The name of the input file to be loaded, including the path.
Normally, this file is a temporary storage for data to be passed to the dbload utility unless named pipe is used instead.
-
If it is not set, a loader file is created in CloverDX or the OS temporary directory. The file is deleted after the load finishes.
-
If it is set, a specified file is created. It is not deleted after data is loaded and it is overwritten on each graph run.
-
If the input port is not connected, this file must exist, must be specified and must contain data that should be loaded into database. It is not deleted or overwritten.
Compatibility
| Version | Compatibility Notice |
|---|---|
4.7.0-M2 |
The attributes Use load utility, User name, Password, Ignore unique key violation and Use insert cursor were deprecated. |
5.3.0 |
InformixDataWriter was renamed to InformixBulkWriter. |