Version
SystemExecute
| The SystemExecute component was removed in CloverDX 7.0. Please use ExecuteScript component instead. |
- CloverDX Data Integration platform
-
Administration
-
Installation
- Designer installation
- Server installation
-
Server cluster setup and configuration
- Cluster introduction
- Cluster configuration
- Recommendations for cluster deployments
-
Troubleshooting
- NodeA cannot establish HTTP connection to NodeB
- NodeA cannot establish TCP connection (Port 7800 by Default) to NodeB
- NodeB is Killed or It Cannot Connect to the Database
- Node cannot access the sandboxes home directory
- Auto-resuming in unreliable network
- Long-term network malfunction may cause jobs to hang on
- Sandboxes in cluster
- Remote edges
- Upgrade
-
Configuration
- Designer configuration
- Server configuration
- Wrangler and Data Manager administration
-
Installation
-
Development
-
First steps with CloverDX Designer
-
CloverDX Designer tutorial
- Terminology
- Creating a project
- Creating a new data file
- Creating a graph
- Placing components in the Graph Editor canvas
- Connecting components by an edge
- Extracting metadata from the input file
- Assigning metadata to the edges
- Setting up Readers (FlatFileReader)
- Setting up Writers (SpreadsheetDataWriter)
- Running the graph
- Opening the output file
- Filtering the records
- Inserting the filter
- Setting up the filter component
- Two data streams
- Sorting the records
- Adding ExtSort
- Setting up the ExtSort component
-
CloverDX Designer tutorial
- Designer user interface
-
Projects
- Types of CloverDX projects
- Structure of CloverDX projects
- Creating CloverDX projects
- Converting CloverDX projects
- Working with CloverDX Server projects
- Versioning of server project content
- Export project as library
- Import Wrangler mapping
-
Job types
- Graphs & development basics
- Subgraphs
- Jobflows
- Data Services
- Execution
-
Job elements
- Components
- Edges
- Metadata
-
Connections
-
Database connections
- Internal database connections
- External (shared) database connections
- Database connection properties
- Encryption of access password
- Browsing database and extracting metadata from database tables
- Snowflake connection
- Hive connection
- Microsoft Access
- Microsoft SQL Server Windows authentication
- Troubleshooting
- JMS connections
- QuickBase connections
- Hadoop connections
- Kafka connections
- OAuth2 connections
- MongoDB connections
- Salesforce connections
-
Database connections
- Parameters
- Sequences
- Lookup tables
- Notes
- Dictionary
- Execution properties
-
CTL2 - CloverDX Transformation Language
- CTL overview
- Language reference
- CTL debugging
-
CTL2 functions reference
- Conversion functions
- Date functions
- Mathematical functions
- String functions
- Mapping functions
- Container functions
- Record functions (dynamic field access)
- Miscellaneous functions
- Lookup table functions
- Sequence functions
- Subgraph functions
- Data Service HTTP Library functions
- Custom CTL functions
- List of all CTL2 functions
- CTL2 appendix - list of national-specific characters
-
Component reference
-
Readers
- Common properties of Readers
- CloverDataReader
- ComplexDataReader
- CustomJavaReader
- DatabaseReader
- DataGenerator
- DBFDataReader
- EDIFACTReader
- EmailReader
- FlatFileReader
- HadoopReader
- HL7Reader
- JavaBeanReader
- JMSReader
- JSONExtract
- JSONReader
- KafkaCommit
- KafkaReader
- LDAPReader
- MongoDBReader
- MultiLevelReader
- ParallelReader
- ParquetReader
- QuickBaseRecordReader
- QuickBaseQueryReader
- ReferenceDataSetReader
- SalesforceBulkReader
- SalesforceReader
- SpreadsheetDataReader
- TransactionalDataSetReader
- UniversalDataReader
- X12Reader
- XMLExtract
- XMLReader
- XMLXPathReader
-
Writers
- Common properties of Writers
- CloverDataWriter
- CustomJavaWriter
- DatabaseWriter
- DB2BulkWriter
- DBFDataWriter
- EDIFACTWriter
- EmailSender
- FlatFileWriter
- HadoopWriter
- InformixBulkWriter
- JavaBeanWriter
- JavaMapWriter
- JMSWriter
- JSONWriter
- KafkaWriter
- LDAPWriter
- MongoDBWriter
- MSSQLBulkWriter
- MySQLBulkWriter
- OracleBulkWriter
- ParquetWriter
- PostgreSQLBulkWriter
- QuickBaseImportCSV
- QuickBaseRecordWriter
- ReferenceDataSetWriter
- SalesforceBulkWriter
- SalesforceWriter
- SalesforceEinsteinWriter
- SnowflakeBulkWriter
- SpreadsheetDataWriter
- StructuredDataWriter
- TransactionalDataSetCommit
- TransactionalDataSetWriter
- Trash
- UniversalDataWriter
- X12Writer
- XMLWriter
- Transformers
- Joiners
- Job Control
- File Operations
- Data Partitioning
- Data Quality
- Others
- Deprecated
-
Readers
-
Advanced
-
Library development best practices
- Introduction
- Usage
- Library file structure
- Enhancing library look and feel
- Parameters
- Initialization jobs (pre-generating metadata)
- User credentials and secrets
- Database/JDBC connections
- OAuth2 connections
- Library dependencies
- Using Java code
- Live debugging and testing
- Job documentation tips
- Data Source Connector development
- Data Target Connector development
- Data partitioning (parallel running)
- Shared lookup tables in CloverDX Server
-
Library development best practices
-
First steps with CloverDX Designer
-
Automation and operations
-
Automation
- Tasks
- Scheduling
- Listeners
- Manual task execution
-
Data Services
- User Interface
-
Using Data Services
- Deploying Data Service
- Publishing and unpublishing Data Service from sandbox
- Publishing Data Service examples
- Changing Data Service to anonymous
- Running Data Service on HTTPS
- Running Data Service on HTTPS on cluster
- Monitoring Data Service
- Testing Data Service
- Performance tuning
- Exporting Data Service configuration
- Importing Data Service configuration
- Avoiding premature marking of Data Service as failing
- Looking up Particular Data Service
- Resetting state of failing Data Service endpoint
- Enabling CORS filter
- Custom HTTP headers
- Data Services on cluster
- Data Apps
- Alerts and notifications
- Operations
- Server management APIs
-
Libraries & sandboxes
- Libraries
- Sandboxes
-
Automation
-
End user’s guide
-
Wrangler user guide
-
Getting started
- How Wrangler works (video)
- Quick tutorial (video)
- Source: Choosing data for your job
- Combining multiple data sources
- Job anatomy: Understanding steps and repeatability
- What to consider before adding a column
- Column data types
- Formulas and calculations
- Modify values based on a condition
- Working with strings (text)
- Working with decimals (including currency)
- Working with dates
- Errors in your data
- No data or some missing?
- No value: Working with null and empty values
- Replacing empty value with a default value
- Filtering data
- Getting results from your job
- Target: Configuring job output
- Mapping your data to specific target
- Data sources and targets
- Data Catalog
- Transforming data
- Transformation steps
-
Getting started
-
Data Manager user guide
- Data Manager introduction
- Data quality – working with transactional data
- Working with reference data
- Editing data in Data Manager
-
Wrangler user guide