Version CloverDX 5.17.2
71. Filtering the records
In this chapter we will learn how to filter records with the Filter component.
This chapter builds on the graph from the Creating a Transformation Graph
-
CloverDX Designer
- CloverDX Overview
- Installation
- Configuration
-
Using Designer
- Designer User Interface
- Projects
- Graphs
- Execution
- Common Dialogs
- Import
- Export
- Graph Tracking
- Search Functionality
- Working with CloverDX Server
-
Graphs
- Components
- Edges
- Metadata
- Connections
- Lookup Tables
- Sequences
- Parameters
- Internal/External Graph Elements
- Dictionary
- Execution Properties
- Notes in Graphs
- Transformations
- Data Partitioning (Parallel Running)
- Data Partitioning in Cluster
- Subgraphs
- Jobflow
-
Data Services
- Data Services Introduction
- Architecture
- Development
-
Use cases
- Creating REST APIs
- Custom Serialization
- Using Static File as Response
- Sending a File Generated by .rjob
- Publishing a Static File
- Using CTL2 Functions in Data Services
- Data Service that Receives a File or Text in Body Part
- Converting Graph to Data Service
- Converting Graphs to Data Service
- Publishing Data Service
- Publishing Multiple Data Services at Once
- Unpublishing Data Service
- Unpublishing Multiple Data Services at Once
- Example
- Troubleshooting
-
Component Reference
-
Readers
- Common Properties of Readers
- CloverDataReader
- ComplexDataReader
- CustomJavaReader
- DatabaseReader
- DataGenerator
- DBFDataReader
- EDIFACTReader
- EmailReader
- FlatFileReader
- HadoopReader
- JavaBeanReader
- JMSReader
- JSONExtract
- JSONReader
- KafkaCommit
- KafkaReader
- LDAPReader
- MongoDBReader
- MultiLevelReader
- ParallelReader
- ParquetReader
- QuickBaseRecordReader
- QuickBaseQueryReader
- SalesforceBulkReader
- SalesforceReader
- SpreadsheetDataReader
- UniversalDataReader
- X12Reader
- XMLExtract
- XMLReader
- XMLXPathReader
-
Writers
- Common Properties of Writers
- CloverDataWriter
- CustomJavaWriter
- DatabaseWriter
- DB2BulkWriter
- DBFDataWriter
- EDIFACTWriter
- EmailSender
- FlatFileWriter
- HadoopWriter
- InformixBulkWriter
- JavaBeanWriter
- JavaMapWriter
- JMSWriter
- JSONWriter
- KafkaWriter
- LDAPWriter
- MongoDBWriter
- MSSQLBulkWriter
- MySQLBulkWriter
- OracleBulkWriter
- ParquetWriter
- PostgreSQLBulkWriter
- QuickBaseImportCSV
- QuickBaseRecordWriter
- SalesforceBulkWriter
- SalesforceWriter
- SalesforceEinsteinWriter
- SnowflakeBulkWriter
- SpreadsheetDataWriter
- StructuredDataWriter
- TableauWriter
- Trash
- UniversalDataWriter
- X12Writer
- XMLWriter
- Transformers
- Joiners
- Job Control
- File Operations
- Data Partitioning
- Data Quality
- Others
- Deprecated
- Incubation
-
Readers
-
CTL2 - CloverDX Transformation Language
- CTL Overview
- Language Reference
- CTL Debugging
-
Functions Reference
- Conversion Functions
- Date Functions
- Mathematical Functions
- String Functions
- Mapping Functions
- Container Functions
- Record Functions (Dynamic Field Access)
- Miscellaneous Functions
- Lookup Table Functions
- Sequence Functions
- Subgraph Functions
- Data Service HTTP Library Functions
- Custom CTL Functions
- List of All CTL2 Functions
- CTL2 Appendix - List of National-specific Characters
-
Tutorial
-
Creating a Transformation Graph
- Terminology
- Creating a Project
- Creating a New Data File
- Creating a Graph
- Placing Components in the Graph Editor Pane
- Connecting Components by an Edge
- Extracting Metadata from the Input File
- Assigning Metadata to the Edges
- Setting Up Readers (FlatFileReader)
- Setting Up Writers (SpreadsheetDataWriter)
- Running the Graph
- Opening the Output File
- Filtering the records
- Sorting the Records
- Processing Speedup with Parallelization
- Debugging the Java Transformation
-
Creating a Transformation Graph
-
CloverDX Server
- Introduction
- Installation
- Configuration
-
Administration
- Operations Dashboard
- Monitoring
- Temp Space Management
- Secure Parameters
- Secret Managers
- Users and Groups
- Sandboxes - Server Side Job Files
- Libraries
- Server Configuration Migration
- Upgrading Server to Newer Version
- Support Package
- Diagnostics
- Troubleshooting Worker
- Alerts and Notification
-
Using Graphs
- Job Queue
- Graph/Jobflow Parameters
- Tasks
- Manual Task Execution
- Scheduling
- Viewing Job Runs - Execution History
- Job Inspector
- Listeners
- Recommendations for Transformations Developers
- Extensibility - CloverDX Engine Plugins
- Troubleshooting
-
API
- Simple HTTP API
- REST API
-
Data Services
- Data Services Overview
- User Interface
-
Using Data Services
- Deploying Data Service
- Publishing and Unpublishing Data Service from Sandbox
- Publishing Data Service Examples
- Changing Data Service to Anonymous
- Running Data Service on HTTPS
- Running Data Service on HTTPS on Cluster
- Monitoring Data Service
- Testing Data Service
- Performance Tuning
- Exporting Data Service Configuration
- Importing Data Service Configuration
- Avoiding Premature Marking of Data Service as Failing
- Looking up Particular Data Service
- Resetting State of Failing Data Service Endpoint
- Enabling CORS Filter
- Custom HTTP Headers
- Data Services on Cluster
- Data Apps
- SOAP WebService API
- JMX mBean
-
Cluster
- Sandboxes in Cluster
- Cluster Configuration
- Recommendations for Cluster Deployment
-
Troubleshooting
- NodeA Cannot Establish HTTP Connection to NodeB
- NodeA Cannot Establish TCP Connection (Port 7800 by Default) to NodeB
- NodeB is Killed or It Cannot Connect to the Database
- Node cannot access the sandboxes home directory
- Auto-Resuming in Unreliable Network
- Long-Term Network Malfunction May Cause Jobs to Hang on
- Security