Version
Using CTL2 Functions in Data Services
There are specific CTL functions designed to deal with Data Service input and output. See Data Service HTTP Library Functions.
-
CloverDX Designer
- CloverDX Overview
- Installation
- Upgrading
- Configuration
-
Using Designer
- Designer User Interface
- Projects
- Graphs
- Execution
- Common Dialogs
- Import
- Export
- Export Project as Library
- Graph Tracking
- Search Functionality
- Working with CloverDX Server
-
Graphs
- Components
- Edges
- Metadata
- Connections
- Lookup Tables
- Sequences
- Parameters
- Internal/External Graph Elements
- Dictionary
- Execution Properties
- Notes in Graphs
- Transformations
- Data Partitioning (Parallel Running)
- Data Partitioning in Cluster
- Subgraphs
- Jobflow
-
Data Services
- Data Services Introduction
- Architecture
- Development
-
Use cases
- Creating REST APIs
- Custom Serialization
- Using Static File as Response
- Sending a File Generated by .rjob
- Publishing a Static File
- Using CTL2 Functions in Data Services
- Data Service that Receives a File or Text in Body Part
- Converting Graph to Data Service
- Publishing Data Service
- Unpublishing Data Service
- Example
- Troubleshooting
-
Libraries Development
-
Libraries
- Introduction
- Usage
- Library File Structure
- Enhancing Library Look and Feel
- Parameters
- Initialization Jobs (pre-generating metadata)
- User Credentials and Secrets
- Database/JDBC Connections
- OAuth2 Connections
- Library Dependencies
- Using Java Code
- Live Debugging and Testing
- Job Documentation Tips
- Data Source Connector Development
- Data Target Connector Development
-
Libraries
-
Component Reference
-
Readers
- Common Properties of Readers
- CloverDataReader
- ComplexDataReader
- CustomJavaReader
- DatabaseReader
- DataGenerator
- DBFDataReader
- EDIFACTReader
- EmailReader
- FlatFileReader
- HadoopReader
- HL7Reader
- JavaBeanReader
- JMSReader
- JSONExtract
- JSONReader
- KafkaCommit
- KafkaReader
- LDAPReader
- MongoDBReader
- MultiLevelReader
- ParallelReader
- ParquetReader
- QuickBaseRecordReader
- QuickBaseQueryReader
- SalesforceBulkReader
- SalesforceReader
- SpreadsheetDataReader
- UniversalDataReader
- X12Reader
- XMLExtract
- XMLReader
- XMLXPathReader
-
Writers
- Common Properties of Writers
- CloverDataWriter
- CustomJavaWriter
- DatabaseWriter
- DB2BulkWriter
- DBFDataWriter
- EDIFACTWriter
- EmailSender
- FlatFileWriter
- HadoopWriter
- InformixBulkWriter
- JavaBeanWriter
- JavaMapWriter
- JMSWriter
- JSONWriter
- KafkaWriter
- LDAPWriter
- MongoDBWriter
- MSSQLBulkWriter
- MySQLBulkWriter
- OracleBulkWriter
- ParquetWriter
- PostgreSQLBulkWriter
- QuickBaseImportCSV
- QuickBaseRecordWriter
- SalesforceBulkWriter
- SalesforceWriter
- SalesforceEinsteinWriter
- SnowflakeBulkWriter
- SpreadsheetDataWriter
- StructuredDataWriter
- Trash
- UniversalDataWriter
- X12Writer
- XMLWriter
- Transformers
- Joiners
- Job Control
- File Operations
- Data Partitioning
- Data Quality
- Others
- Deprecated
-
Readers
-
CTL2 - CloverDX Transformation Language
- CTL Overview
- Language Reference
- CTL Debugging
-
Functions Reference
- Conversion Functions
- Date Functions
- Mathematical Functions
- String Functions
- Mapping Functions
- Container Functions
- Record Functions (Dynamic Field Access)
- Miscellaneous Functions
- Lookup Table Functions
- Sequence Functions
- Subgraph Functions
- Data Service HTTP Library Functions
- Custom CTL Functions
- List of All CTL2 Functions
- CTL2 Appendix - List of National-specific Characters
-
Tutorial
-
Creating a Transformation Graph
- Terminology
- Creating a Project
- Creating a New Data File
- Creating a Graph
- Placing Components in the Graph Editor Pane
- Connecting Components by an Edge
- Extracting Metadata from the Input File
- Assigning Metadata to the Edges
- Setting Up Readers (FlatFileReader)
- Setting Up Writers (SpreadsheetDataWriter)
- Running the Graph
- Opening the Output File
- Filtering the records
- Sorting the Records
-
Creating a Transformation Graph
-
CloverDX Wrangler
-
Getting started
- How Wrangler works (video)
- Quick tutorial (video)
- Source: Choosing data for your job
- Combining multiple data sources
- Job anatomy: Understanding steps and repeatability
- What to consider before adding a column
- Column data types
- Formulas and calculations
- Modify values based on a condition
- Working with strings (text)
- Working with decimals (including currency)
- Working with dates
- Errors in your data
- No data or some missing?
- No value: Working with null and empty values
- Replacing empty value with a default value
- Filtering data
- Getting results from your job
- Target: Configuring job output
- Mapping your data to specific target
-
Data sources and targets
- Introduction
- Data sources
- Data targets
- Data Catalog
- Transforming data
- Transformation steps
-
Getting started
-
CloverDX Server
- Introduction
- Installation
-
Configuration
- Configuration Introduction
- Configuration Sources
- Example Configuration File
- Setup
- System Database Configuration
- List of Configuration Properties
- Secure Configuration Properties
- Logging
- Engine Configuration
- JMX Configuration
- Instance Indicator
- Branding of CloverDX Server
-
Administration
- Monitoring
- Temp Space Management
- Secure Parameters
- Secret Managers
- Users and Groups
- Sandboxes - Server Side Job Files
- Libraries
- Wrangler
- Server Configuration Migration
- Support Package
- Diagnostics
- Troubleshooting Worker
- Alerts and Notification
-
Using Graphs
- Job Queue
- Graph/Jobflow Parameters
- Tasks
- Manual Task Execution
- Scheduling
- Viewing Job Runs - Execution History
- Job Inspector
- Listeners
- Extensibility - CloverDX Engine Plugins
-
API
- Simple HTTP API
- REST API
-
Data Services
- Data Services Overview
- User Interface
-
Using Data Services
- Deploying Data Service
- Publishing and Unpublishing Data Service from Sandbox
- Publishing Data Service Examples
- Changing Data Service to Anonymous
- Running Data Service on HTTPS
- Running Data Service on HTTPS on Cluster
- Monitoring Data Service
- Testing Data Service
- Performance Tuning
- Exporting Data Service Configuration
- Importing Data Service Configuration
- Avoiding Premature Marking of Data Service as Failing
- Looking up Particular Data Service
- Resetting State of Failing Data Service Endpoint
- Enabling CORS Filter
- Custom HTTP Headers
- Data Services on Cluster
- Data Apps
- SOAP WebService API
-
Cluster
- Sandboxes in Cluster
- Cluster Configuration
- Recommendations for Cluster Deployment
-
Troubleshooting
- NodeA Cannot Establish HTTP Connection to NodeB
- NodeA Cannot Establish TCP Connection (Port 7800 by Default) to NodeB
- NodeB is Killed or It Cannot Connect to the Database
- Node cannot access the sandboxes home directory
- Auto-Resuming in Unreliable Network
- Long-Term Network Malfunction May Cause Jobs to Hang on
- Security