Execution Properties
Each graph or jobflow may have a set of execution properties which are applied during its execution, for example to change the log level, number of parallel executions etc. The properties can be set in the job's XML file (via Designer) or in the Server Console.
Priorities (from highest to lowest):
job-level setting - execution properties set on a job in the Sandboxes section of Server Console have the highest priority. The properties are set in the Execution Properties tab of a selected job file.
sandbox-level setting - execution properties set on a sandbox in the Sandboxes section of Server Console set the property for all jobs in the sandbox. This can be overridden by the above job-level setting. The properties are set in the Execution Properties tab of a selected sandbox.
job XML file setting - execution properties set in a job XML file (via the Designer) have lower priority than the above job and sandbox level settings. However, their benefit is that they are versioned and moved with the job file, which simplifies their management. The execution properties set in the job's XML file can be considered as default for the job, and can be overridden on the sandbox or job level in the Server Console.
The execution property values set in the graph XML can use graph parameters, for a more centralized configuration. The graph parameters are resolved during loading and parsing of the XML file, thus such a job cannot be pooled.
global defaults - global Server configuration defines default values for all of the execution properties. Global execution properties related to job execution properties have the
executor.
prefix. For example, the Server propertyexecutor.classpath
is default for the execution propertyclasspath
. (See Part III, “Configuration” for details.)
If you use a relative path, the path is relative to ${SANDBOX_ROOT}
.
In a path definition, you can use system properties - e.g. ${java.io.tmpdir}
-
and some of server configuration properties: ${sandboxes.home}
,
${sandboxes.home.partitioned}
and ${sandboxes.home.local}
.
Table 26.4. Execution Properties
Property name | Default value | Description |
---|---|---|
classloader_caching |
false
|
CloverDX creates new classloaders when necessary to load a class in runtime.
For example, a Reformat component with a Java transformation has to create a new classloader to load the class.
It is worth noting that classloaders for JDBC drivers are not re-created.
Classloader cache is used to avoid PermGen out of memory errors
(some JDBC drivers automatically register themselves to DriverManager,
which can cause that the classloader cannot be released by the garbage collector).
This behavior can be inconvenient, for example if you want to share POJO between components.
For example, a Reformat component creates an object
(from a |
classpath |
List of paths or | |
compile_classpath |
List of paths or | |
debug_mode |
false
|
If
Without explicit setting,
running of a graph from Designer with server integration would set the debug_mode to |
delete_obsolete_temp_files |
false
|
If
This property is useful together with enabled debug mode ensuring
that obsolete debug files from previous runs of a job are removed from temp space.
This property is set to |
enqueue_executions |
false
| Boolean value.
If
if This property is evaluated after the job queue, see Job Queue Impact. |
jobflow_token_tracking |
true
| If false , token tracking in jobflow executions will be disabled. |
locale | DEFAULT_LOCALE engine property |
Can be used to override the DEFAULT_LOCALE engine property.
|
log_level | INFO |
Log4j 2 log level for this graph executions. ( |
max_running_concurrently |
unlimited
| The maximum number of concurrently running instances of this transformation. In Cluster environment, the limit is per node. This property is evaluated after the job queue, see Job Queue Impact. |
queueable |
|
Can be used to override default behavior of the job queue (see Job Queue) for this job.
The job queue by default processes most types of jobs (e.g. graphs, jobflows, subgraphs etc.) and ignores some types of jobs (Data Services).
This execution property can be used to override the default behavior on this job, if it's set.
If set to If the execution property is set on a job, its value is propagated to child jobs. For example, if job queue is disabled for a job, then it's disabled for all its child jobs such as subgraphs etc. By default Data Services are not processed by the job queue. This execution property can be used to enable job queue on specific Data Services, e.g. such that are used for orchestration of job executions. |
skip_check_config | default value is taken from engine property | Specifies whether check config must be performed before a transformation execution. |
time_zone | DEFAULT_TIME_ZONE engine property |
Can be used to override the DEFAULT_TIME_ZONE engine property.
|
tracking_interval |
2000
| Interval in milliseconds for sampling nodes status in a running transformation. |
use_jmx | true | If true , job executor registers jmx mBean of a running transformation. |
use_local_context_url |
false
|
If |
verbose_mode |
true
| If true , more descriptive logs of job runs are generated. |
worker_execution |
true
|
Set to |
Figure 26.6. Execution Properties