CloverDX Server

    User's Guide

    This User's Guide refers to CloverDX Server 5.3.x release.

    Do not copy or distribute without express permission of CloverDX a.s.

    Feedback welcome:

    If you have any comments or suggestions for this documentation, please send them by email to .

    Consider How to speed up communication with CloverCARE support before contacting the support.

    Table of Contents

    I. Introduction
    1. What is CloverDX Server?
    2. CloverDX Server Architecture
    3. CloverDX Core
    4. CloverDX Worker
    5. CloverDX Cluster
    II. Installation
    6. System Requirements
    7. Installing
    Evaluation Server
    Production Server
    Apache Tomcat
    IBM WebSphere
    JBoss Enterprise Application Platform
    Oracle WebLogic Server
    CloverDX Server Activation Alternatives
    IBM InfoSphere MDM Plugin Installation
    Installation into Server
    8. Postinstallation Configuration
    Memory Settings
    Maximum Number of Open Files
    Maximum Number of Processes or Threads
    Firewall Exceptions
    Garbage Collector for Worker
    9. Optional Installation Steps
    Adding Libraries to the Worker's Classpath
    Worker Support for SMB 2.x and 3.x
    10. Troubleshooting
    III. Configuration
    11. Configuration Introduction
    12. Configuration Sources
    Configuration File on Specified Location
    Alternative Configuration Sources
    Priorities of Configuration Sources
    Specifying the Path to the Configuration File
    13. Setup
    Before You Start
    Using Setup
    Configuration File
    14. System Database Configuration
    Embedded Apache Derby
    Creating Database
    CloverDX Server Setup
    Creating Database
    CloverDX Server Setup
    DB2 on AS/400
    Creating Database
    CloverDX Server Setup
    Microsoft SQL Server
    Creating Database
    CloverDX Server Setup
    Creating Database
    CloverDX Server Setup
    JNDI Configuration and Encryption
    JNDI DB Datasource
    JNDI Datasource Troubleshooting
    Encrypted JNDI
    15. List of Configuration Properties
    General Configuration Properties
    Worker - Configuration Properties
    Worker - JNDI Properties
    JDBC Datasources
    JMS Connections
    Worker - SSL Properties
    Properties on Worker's Command Line
    Job Execution Properties
    List of all properties
    16. Secure Configuration Properties
    17. Logging
    IV. Administration
    18. Monitoring
    Standalone Server Detail
    Cluster Overview
    Node Detail
    Server Logs
    Using the Monitoring
    Restarting the Worker
    Showing Worker's Command Line Arguments
    Suspending the Server
    Resuming the Server
    Displaying List of Threads of the Server Core
    19. Temp Space Management
    Temp Space Overview
    20. Secure Parameters
    21. Users and Groups
    LDAP Authentication
    SAML Authentication
    User Lockout
    22. Sandboxes - Server Side Job Files
    Referencing Files from the Graph or Jobflow
    Sandbox Content Security and Permissions
    Sandbox Content and Options
    Download sandbox as ZIP
    Upload ZIP to sandbox
    Download file in ZIP
    Delete Sandbox
    Job Config Properties
    WebDAV Access to Sandboxes
    WebDAV Clients
    WebDAV Authentication/Authorization
    23. Server Configuration Migration
    Server Configuration Export
    Server Configuration Import
    24. Upgrading Server to Newer Version
    25. Diagnostics
    26. Troubleshooting Worker
    V. Using Graphs
    27. Graph/Jobflow Parameters
    Parameters by Execution Type
    Adding Another Graph Parameters
    28. Tasks
    Send an Email
    Execute Shell Command
    Start a Graph
    Start a Jobflow
    Start a Profiler Job
    Abort job
    Archive Records
    Send a JMS Message
    Execute Groovy Code
    29. Manual Task Execution
    30. Scheduling
    Timetable Setting
    Allocations of Scheduled Task on Nodes
    Scheduling the Tasks - Examples
    Start a graph at specific time
    Start a Jobflow once an hour
    Complex Scheduling
    31. Viewing Job Runs - Execution History
    Filtering and ordering
    Log File
    32. Listeners
    Graph Event Listeners
    Graph Events
    Use Cases
    Jobflow Event Listeners
    Jobflow Events
    JMS Message Listeners
    Universal Event Listeners
    Evaluation Criteria
    File Event Listeners (remote and local)
    Cluster environment
    Supported filesystems and protocols
    Observed file
    File Events
    Check Interval, Task and Use Cases
    Task Failure Listeners
    Task Choice
    Task Failed E-mail Template
    33. Recommendations for Transformations Developers
    34. Extensibility - CloverDX Engine Plugins
    35. Troubleshooting
    VI. API
    36. Simple HTTP API
    37. JMX mBean
    JMX Configuration
    How to configure JMX on Apache Tomcat
    How to Configure JMX on WebSphere
    Possible Problems
    38. SOAP WebService API
    SOAP WS Client
    SOAP WS API Authentication/Authorization
    39. Launch Services
    Launch Services Authentication
    Sending the Data to Launch Service
    Results of the Graph Execution
    40. Data Services
    Data Services Overview
    User Interface
    List of Data Services
    Testing and Documentation
    State and History
    Alerts and Notification
    Catalog of Services
    Built-in Data Service Examples
    HTTPS Connectors
    Using Data Services
    Deploying Data Service
    Publishing and Unpublishing Data Service from Sandbox
    Publishing Data Service Examples
    Changing Data Service to Anonymous
    Running Data Service on HTTPS
    Running Data Service on HTTPS on Cluster
    Monitoring Data Service
    Testing Data Service
    Performance Tuning
    Exporting Data Service Configuration
    Importing Data Service Configuration
    Avoiding Premature Marking of Data Service as Failing
    Looking up Particular Data Service
    Resetting State of Failing Data Service Endpoint
    Custom HTTP Headers
    Data Services on Cluster
    VII. Cluster
    41. Sandboxes in Cluster
    Using a Sandbox Resource as a Component Data Source
    Remote Edges
    42. Cluster Configuration
    Mandatory Cluster Properties
    Optional Cluster Properties
    Example of 2 Node Cluster Configuration
    Basic 2-nodes Cluster Configuration
    2-nodes Cluster with Proxied Access to Database
    2-nodes Cluster with Load Balancer
    Example of 3 Node Cluster Configuration
    Basic 3-nodes Cluster Configuration
    Jobs Load Balancing Properties
    Running More Clusters
    43. Recommendations for Cluster Deployment
    44. Troubleshooting
    NodeA Cannot Establish HTTP Connection to NodeB
    NodeA Cannot Establish TCP Connection (Port 7800 by Default) to NodeB
    NodeB is Killed or It Cannot Connect to the Database
    Auto-Resuming in Unreliable Network
    Long-Term Network Malfunction May Cause Jobs to Hang on
    VIII. Security
    45. Security Recommendations for CloverDX Server