Chapter 31. Viewing Job Runs - Execution History

Filtering and ordering
Tracking
Log File

Execution History shows the history of all jobs that the Server has executed – transformation graphs, jobflows, and Data Profiler jobs. You can use it to find out why a job failed, see the parameters that were used for a specific run, and much more.

The table shows basic information about the job: Run ID, Node, Job file, Executed by, Status, and time of execution. After clicking on a row in the list, you can see additional details of the respective job, such as associated log files, parameter values, tracking and more.

[Note]Note

Some jobs might not appear in the Execution History list. These are jobs that have disabled persistency for increased performance (for example, some Launch Services disable storing the run information in order to increase service responsiveness).

Filtering and ordering

Use the Filter panel to filter the view. By default, only parent tasks are shown (Show executions children) – e.g. master nodes in a cluster and their workers are hidden by default.

Use the up and down arrows in the table header to sort the list. By default, the latest job is listed first.

Execution History - executions table

Figure 31.1. Execution History - executions table


When some job execution is selected in the table, the detail info is shown on the right side.

Table 31.1. Persistent run record attributes

AttributeDescription
Run ID A unique number identifying the run of the job. Server APIs usually return this number as a simple response to the execution request. It is useful as a parameter of subsequent calls for specification of the job execution.
Execution type A type of a job as recognized by the Server. STANDALONE for graph, JOBFLOW for Jobflow, PROFILER_JOB for profiler, MASTER for the main record of partitioned execution in a cluster, PARTITIONED_WORKER for the worker record of partitioned execution in a cluster
Parent run ID A run ID of the parent job. Typically the jobflow which executed this job, or master execution which encapsulates this worker execution.
Root run IDA run ID of the root parent job. Job execution which wasn't executed by another parent job.
Execution group Jobflow components may group sub-jobs using this attribute. See the description of Jobflow components for details.
Nested jobsIndication that this job execution has or has not any child execution.
NodeIn cluster mode, it shows the ID of the cluster node which this execution was running on.
ExecutorIf it runs on worker, it contains the text "worker".
Executed byThe user who executed the job. Either directly using some API/GUI or indirectly using the scheduling or event listeners.
Sandbox The sandbox containing a job file. For jobs which are sent together with an execution request, so the job file doesn't exist on the Server site, it is set to the "default" sandbox.
Job file A path to a job file, relative to the sandbox root. For jobs which are sent together with an execution request, so the job file doesn't exist on the Server site, it is set to generated string.
Job version The revision of the job file. A string generated by CloverDX Designer and stored in the job file.
Status Status of the job execution. READY - waiting for execution start, RUNNING - processing the job, FINISHED OK - the job finished without any error, ABORTED - the job was aborted directly using some API/GUI or by the parent jobflow, ERROR - the job failed, N/A (not available) - the server process died suddenly, so it couldn't properly abort the jobs. After restart, the jobs with unknown status are set as N/A
StartedServer date-time (and timezone) of the execution start.
FinishedServer date-time (and timezone) of the execution finish.
DurationExecution duration
Error in component IDIf the job failed due the error in a component, this field contains the ID of the component.
Error in component typeIf the job failed due the error in a component, this field contains type of the component.
Error messageIf the job failed, this field contains the error description.
ExceptionIf the job failed, this field contains error stack trace.
Input parameters A list of input parameters passed to the job. A job file can't be cached, since the parameters are applied during loading from the job file. The job file isn't cached, by default.
Input dictionary A list of dictionary elements passed to the job. A dictionary is used independently of job file caching.
Output dictionaryA list of dictionary elements at the moment the job ends.

For jobs which have some children executions, e.g. partitioned or jobflows also an executions hierarchy tree is shown.

Execution History - overall perspective

Figure 31.2. Execution History - overall perspective


[Tip]Tip

Since the detail panel, and especially job logs, may be wide, it may be useful to hide a table on the left, so the detail panel spreads. Click on the minimize icon on the top of the list panel to hide the panel. Then to show list panel again, click to the "Expand panel" icon on the left.

Executions Hierarchy with docked list of jobs

Figure 31.3. Executions Hierarchy with docked list of jobs


Executions hierarchy may be rather complex, so it's possible to filter the content of the tree by a fulltext filter. However when the filter is used, the selected executions aren't hierarchically structured.

Tracking

The Tracking tab, contains details about the selected job:

Table 31.2. Tracking table information

AttributeDescription
Component IDThe ID of the component.
Component nameThe name of the component.
Status Status of data processing in the respective component.
  • FINISHED_OK: data was successfully processed

  • ABORTED: data processing has been aborted

  • N_A: status unknown

  • ERROR: an error occurred while data was processed by the component

CPUCPU usage of the component.
PortComponent's ports (both input and output) that were used for data transfer.
RecordsThe number of records transferred through the port of the component.
kBAmount of data transferred in kB.
Records/sThe number of records processed per second
KB/sData transfer speed in KB.
Records/s peakThe peak value of Records/s.
KB/s peakThe peak value of KB/s.

Execution History - Tracking

Figure 31.4. Execution History - Tracking


Log File

In the Log file tab, you can see the log of the job run with detailed information. A log with a green background indicates a successfully run job, while a red background indicates an error.

You can download the log as a plain text file by clicking Download log or as a zip archive by clicking Download log (zipped).

Execution History - Tracking

Figure 31.5. Execution History - Tracking