Version
Transformation steps
Wrangler implements a large number of steps that help you work with your data - steps that validate your data, clean it, compute mathematical formulas, and more.
- CloverDX Data Integration platform
-
Administration
-
Installation
- Designer installation
- Server installation
-
Server cluster setup and configuration
- Cluster introduction
- Cluster configuration
- Recommendations for cluster deployments
-
Troubleshooting
- NodeA cannot establish gRPC connection to NodeB
- NodeA cannot establish TCP connection (Port 7800 by Default) to NodeB
- NodeB is Killed or It Cannot Connect to the Database
- Node cannot access the sandboxes home directory
- Auto-resuming in unreliable network
- Long-term network malfunction may cause jobs to hang on
- Sandboxes in cluster
- Remote edges
- Upgrade
-
Configuration
- Designer configuration
-
Server configuration
- Configuration properties and sources
- User management and access control
- Securing sensitive data
- Securing Server with HTTPS
- Temp space management
- Server configuration export/import
- Server configuration via Setup module
- JMX configuration
- CloverDX MCP Server
- Instance indicator
- Branding of CloverDX Server
- Wrangler and Data Manager administration
-
Installation
-
Development
-
First steps with CloverDX Designer
-
CloverDX Designer tutorial
- Terminology
- Creating a project
- Creating a new data file
- Creating a graph
- Placing components in the Graph Editor canvas
- Connecting components by an edge
- Extracting metadata from the input file
- Assigning metadata to the edges
- Setting up Readers (FlatFileReader)
- Setting up Writers (SpreadsheetDataWriter)
- Running the graph
- Opening the output file
- Filtering the records
- Inserting the filter
- Setting up the filter component
- Two data streams
- Sorting the records
- Adding ExtSort
- Setting up the ExtSort component
-
CloverDX Designer tutorial
- Designer user interface
-
Projects
- Types of CloverDX projects
- Structure of CloverDX projects
- Creating CloverDX projects
- Converting CloverDX projects
- Working with CloverDX Server projects
- Versioning of server project content
- Export project as library
- Import Wrangler mapping
-
Job types
- Graphs & development basics
- Subgraphs
- Jobflows
- Data Services
- Execution
-
Job elements
- Components
- Edges
- Metadata
-
Connections
-
Database connections
- Internal database connections
- External (shared) database connections
- Database connection properties
- Encryption of access password
- Browsing database and extracting metadata from database tables
- Snowflake connection
- Hive connection
- Microsoft Access
- Microsoft SQL Server Windows authentication
- Troubleshooting
- JMS connections
- QuickBase connections
- Hadoop connections
- Kafka connections
- OAuth2 connections
- MongoDB connections
- Salesforce connections
-
Database connections
- Parameters
- Sequences
- Lookup tables
- Notes
- Dictionary
- Execution properties
-
CTL2 - CloverDX Transformation Language
- CTL overview
- Language reference
- CTL debugging
-
CTL2 functions reference
- Conversion functions
- Date functions
- Mathematical functions
- String functions
- Mapping functions
- Container functions
- Record functions (dynamic field access)
- Miscellaneous functions
- Lookup table functions
- Sequence functions
- Subgraph functions
- Data Service HTTP Library functions
- Custom CTL functions
- List of all CTL2 functions
- CTL2 appendix - list of national-specific characters
-
Component reference
-
Readers
- Common properties of Readers
- CloverDataReader
- ComplexDataReader
- CustomJavaReader
- DatabaseReader
- DataGenerator
- DBFDataReader
- EDIFACTReader
- EmailReader
- FlatFileReader
- HadoopReader
- HL7Reader
- JavaBeanReader
- JMSReader
- JSONExtract
- JSONReader
- KafkaCommit
- KafkaReader
- LDAPReader
- MongoDBReader
- MultiLevelReader
- ParallelReader
- ParquetReader
- QuickBaseRecordReader
- QuickBaseQueryReader
- ReferenceDataSetReader
- SalesforceBulkReader
- SalesforceReader
- SpreadsheetDataReader
- TransactionalDataSetReader
- UniversalDataReader
- X12Reader
- XMLExtract
- XMLReader
- XMLXPathReader
-
Writers
- Common properties of Writers
- CloverDataWriter
- CustomJavaWriter
- DatabaseWriter
- DB2BulkWriter
- DBFDataWriter
- EDIFACTWriter
- EmailSender
- FlatFileWriter
- HadoopWriter
- InformixBulkWriter
- JavaBeanWriter
- JavaMapWriter
- JMSWriter
- JSONWriter
- KafkaWriter
- LDAPWriter
- MongoDBWriter
- MSSQLBulkWriter
- MySQLBulkWriter
- OracleBulkWriter
- ParquetWriter
- PostgreSQLBulkWriter
- QuickBaseImportCSV
- QuickBaseRecordWriter
- ReferenceDataSetWriter
- SalesforceBulkWriter
- SalesforceWriter
- SalesforceEinsteinWriter
- SnowflakeBulkWriter
- SpreadsheetDataWriter
- StructuredDataWriter
- TransactionalDataSetCommit
- TransactionalDataSetWriter
- Trash
- UniversalDataWriter
- X12Writer
- XMLWriter
- Transformers
- AI Components
- Joiners
- Job Control
- File Operations
- Data Partitioning
- Data Quality
- Others
- Deprecated
-
Readers
-
Advanced
-
Library development best practices
- Introduction
- Usage
- Library file structure
- Enhancing library look and feel
- Parameters
- Initialization jobs (pre-generating metadata)
- User credentials and secrets
- Database/JDBC connections
- OAuth2 connections
- Library dependencies
- Using Java code
- Live debugging and testing
- Job documentation tips
- Data Source Connector development
- Data Target Connector development
- Data partitioning (parallel running)
- Shared lookup tables in CloverDX Server
-
Library development best practices
-
First steps with CloverDX Designer
-
Automation and operations
-
Automation
- Tasks
- Scheduling
- Listeners
- Manual task execution
-
Data Services
- User Interface
-
Using Data Services
- Deploying Data Service
- Publishing and unpublishing Data Service from sandbox
- Publishing Data Service examples
- Changing Data Service to anonymous
- Running Data Service on HTTPS
- Running Data Service on HTTPS on cluster
- Monitoring Data Service
- Testing Data Service
- Performance tuning
- Exporting Data Service configuration
- Importing Data Service configuration
- Avoiding premature marking of Data Service as failing
- Looking up Particular Data Service
- Resetting state of failing Data Service endpoint
- Enabling CORS filter
- Custom HTTP headers
- Data Services on cluster
- Data Apps
- Alerts and notifications
- Operations
- Server management APIs
- Data Manager API
-
Libraries, Sandboxes, and AI / ML Models modules
- Libraries
- AI / ML Models module
- Sandboxes
-
Automation
-
End user’s guide
-
Wrangler user guide
- Tutorial: Getting started with Wrangler
- Workspaces
- Data sources and targets
- Data Catalog
- Transforming data
- Transformation steps
-
Frequently Asked Questions
- How do transformation steps work? Why are they needed?
- How to choose data source for your job?
- How can I combine multiple data sources? (Join? Lookup?)
- How can I configure where my job output goes? How do I use data targets?
- How can I get full output from my job?
- What data types can column have?
- Do I always need to add columns with Add column step?
- How can I use strings? How to work with text data?
- How can I work with precise numbers (including currency)?
- How do date values work?
- How do formulas work?
- How can I modify values based on a condition?
- How does Wrangler handle errors in my data?
- Why cannot I see any data? Why is some data missing?
- How do I work with empty values? What’s the difference between null and empty?
- How can I populate empty cells with default value?
- How can I filter my data?
- How can I build mapping between my data layout and the layout required by a data target?
- Getting started (legacy)
-
Data Manager user guide
- Data Manager introduction
- Data quality – working with transactional data
- Working with reference data
- Editing data in Data Manager
-
Wrangler user guide