CloverDX Server

User's Guide

This User's Guide refers to CloverDX Server 5.1.x release.

Do not copy or distribute without express permission of CloverDX.

Feedback welcome:

If you have any comments or suggestions for this documentation, please send them by email to .

Consider How to speed up communication with CloverCARE support before contacting the support.


Table of Contents

I. Introduction
1. What is CloverDX Server?
2. CloverDX Server Architecture
3. CloverDX Core
4. CloverDX Worker
5. CloverDX Cluster
II. Installation
6. System Requirements
7. Installing
Evaluation Server
Installation
Production Server
Apache Tomcat
IBM WebSphere
JBoss Enterprise Application Platform
Oracle WebLogic Server
Activation
CloverDX Server Activation Alternatives
IBM InfoSphere MDM Plugin Installation
Installation into Server
8. Postinstallation Configuration
Memory Settings
Maximum Number of Open Files
Maximum Number of Processes or Threads
Firewall Exceptions
Garbage Collector for Worker
9. Optional Installation Steps
Adding Libraries to the Worker's Classpath
Worker Support for SMB 2.x and 3.x
10. Troubleshooting
III. Configuration
11. Configuration Introduction
12. Configuration Sources
Configuration File on Specified Location
Alternative Configuration Sources
Priorities of Configuration Sources
Specifying the Path to the Configuration File
13. Setup
Before You Start
Using Setup
Configuration File
License
Database
Worker
Sandboxes
Encryption
E-Mail
LDAP
Cluster
14. System Database Configuration
Embedded Apache Derby
MySQL
Creating Database
CloverDX Server Setup
DB2
Creating Database
CloverDX Server Setup
DB2 on AS/400
Oracle
Creating Database
CloverDX Server Setup
Microsoft SQL Server
Creating Database
CloverDX Server Setup
PostgreSQL
Creating Database
CloverDX Server Setup
JNDI Configuration and Encryption
JNDI DB Datasource
JNDI Datasource Troubleshooting
Encrypted JNDI
15. List of Configuration Properties
General Configuration Properties
Worker - Configuration Properties
Worker - JNDI Properties
JDBC Datasources
JMS Connections
Worker - SSL Properties
Properties on Worker's Command Line
Job Execution Properties
List of all properties
16. Secure Configuration Properties
17. Logging
IV. Administration
18. Monitoring
Standalone Server Detail
Cluster Overview
Node Detail
Server Logs
Using the Monitoring
Restarting the Worker
Showing Worker's Command Line Arguments
Suspending the Server
Resuming the Server
Displaying List of Threads of the Server Core
19. Temp Space Management
Temp Space Overview
Management
20. Secure Parameters
21. Users and Groups
LDAP Authentication
Users
Groups
User Lockout
22. Sandboxes - Server Side Job Files
Referencing Files from the Graph or Jobflow
Sandbox Content Security and Permissions
Sandbox Content and Options
Download sandbox as ZIP
Upload ZIP to sandbox
Download file in ZIP
Delete Sandbox
Job Config Properties
WebDAV Access to Sandboxes
WebDAV Clients
WebDAV Authentication/Authorization
23. Server Configuration Migration
Server Configuration Export
Server Configuration Import
24. Upgrading Server to Newer Version
25. Diagnostics
26. Troubleshooting Worker
V. Using Graphs
27. Graph/Jobflow Parameters
Parameters by Execution Type
Adding Another Graph Parameters
28. Tasks
Send an Email
Placeholders
Execute Shell Command
Start a Graph
Start a Jobflow
Start a Profiler Job
Abort job
Archive Records
Send a JMS Message
Execute Groovy Code
29. Manual Task Execution
30. Scheduling
Timetable Setting
Allocations of Scheduled Task on Nodes
Scheduling the Tasks - Examples
Start a graph at specific time
Start a Jobflow once an hour
Complex Scheduling
31. Viewing Job Runs - Execution History
Filtering and ordering
Tracking
Log File
32. Listeners
Graph Event Listeners
Graph Events
Listener
Tasks
Use Cases
Jobflow Event Listeners
Jobflow Events
Listener
Tasks
JMS Message Listeners
Universal Event Listeners
Evaluation Criteria
File Event Listeners (remote and local)
Cluster environment
Supported filesystems and protocols
Observed file
File Events
Check Interval, Task and Use Cases
Howtos
Task Failure Listeners
Task Choice
Task Failed E-mail Template
33. Recommendations for Transformations Developers
34. Extensibility - CloverDX Engine Plugins
35. Troubleshooting
VI. API
36. Simple HTTP API
37. JMX mBean
JMX Configuration
Operations
38. SOAP WebService API
SOAP WS Client
SOAP WS API Authentication/Authorization
39. Launch Services
Launch Services Authentication
Sending the Data to Launch Service
Results of the Graph Execution
40. Data Services
Data Services Overview
User Interface
List of Data Services
Detail
Testing and Documentation
State and History
Alerts and Notification
Configuration
Catalog of Services
Built-in Data Service Examples
HTTPS Connectors
Using Data Services
Deploying Data Service
Publishing and Unpublishing Data Service from Sandbox
Publishing Data Service Examples
Changing Data Service to Anonymous
Running Data Service on HTTPS
Running Data Service on HTTPS on Cluster
Monitoring Data Service
Testing Data Service
Performance Tuning
Exporting Data Service Configuration
Importing Data Service Configuration
Avoiding Premature Marking of Data Service as Failing
Looking up Particular Data Service
Resetting State of Failing Data Service Endpoint
Custom HTTP Headers
Data Services on Cluster
VII. Cluster
41. Sandboxes in Cluster
Using a Sandbox Resource as a Component Data Source
Remote Edges
42. Cluster Configuration
Mandatory Cluster Properties
Optional Cluster Properties
Example of 2 Node Cluster Configuration
Basic 2-nodes Cluster Configuration
2-nodes Cluster with Proxied Access to Database
2-nodes Cluster with Load Balancer
Example of 3 Node Cluster Configuration
Basic 3-nodes Cluster Configuration
Jobs Load Balancing Properties
Running More Clusters
43. Recommendations for Cluster Deployment
44. Troubleshooting
NodeA Cannot Establish HTTP Connection to NodeB
NodeA Cannot Establish TCP Connection (Port 7800 by Default) to NodeB
NodeB is Killed or It Cannot Connect to the Database
Auto-Resuming in Unreliable Network
Long-Term Network Malfunction May Cause Jobs to Hang on
VIII. Security
45. Security Recommendations for CloverDX Server