Version

    24. Connections

    The Connections chapter provides comprehensive guidance on configuring and managing various types of connections in CloverDX job files. Understanding how to set up and maintain these connections is crucial for enabling seamless data integration and communication across different systems and services.

    • Database connections allow CloverDX to access and manipulate data in various database sources. With these connections, you can read data from database tables, perform SQL queries, and insert records using components designed for database interaction. CloverDX supports two primary methods of accessing databases: connecting via a JDBC driver or using a native client utility for bulk loading operations (see the bulk components in Writers). JDBC drivers for commonly used databases are included with CloverDX Designer by default; however, you can also add other jdbc drivers if needed.

      Database connections can be categorized as internal (available only in the job file they were created in) or external (shared), with the flexibility to convert between the two as needed. This section also provides detailed information on configuring database connection properties, encrypting access passwords, and using database connections to create metadata.

    • JMS (Java Message Service) connections facilitate the exchange of JMS messages. This section explains how to configure internal and external JMS connections, utilize the JMS connection wizard, and ensure the security of authentication passwords through encryption.

    • To connect to the QuickBase platform, you can use the integrated feature for QuickBase connection.

    • To leverage Hadoop’s distributed computing capabilities, this section outlines how to configure a Hadoop connection, how to manage necessary libraries, or how to set up Kerberos authentication for secure Hadoop interactions.

    • Learn how to create and configure Kafka connections for stream processing and real-time data integration, along with details on specific configuration options.

    • OAuth2 connections in CloverDX allow you to obtain an OAuth2 access token, which can be used for authorization with the APIs of external services. These connections can be used in conjunction with the HTTPConnector component or to provide tokens within the CTL2 language. When setting up an OAuth2 connection, you can select from a list of predefined providers or specify a generic provider to configure the connection according to your needs.

    • In MongoDB connections, guidance on connecting to MongoDB is provided, enabling CloverDX to interact with MongoDB databases effectively.

    • For integrating with Salesforce, this section covers the steps to create Salesforce connections, along with key details to ensure a smooth and secure connection setup.