How to Build Custom Connectors Like a Wizard

In the world of data integration, there's a growing need to connect to a wide variety of data sources. While many data integration tools offer pre-built connectors to popular data sources, you might encounter situations where you need to connect to a source that isn't covered by existing connectors. This is where the newly announced INFAConnect changes the game. In this blog, we will explore the process of building custom connectors using INFAConnect that empowers your data integration workflows.

• Complexity: Connector development is generally considered a complex process that requires programming skills and working with multiple Software Development Kits (SDK) which consumes a lot of time.
• Operationalizing the connector: Many users find it difficult to manage a connector through its lifecycle which involves featuring new versions, fixing issues and seamless provisioning.
• Extensibility: Most of the SDKs generally work for Data Integration use cases and are not compatible with other use cases such as data governance, master data management (MDM), etc. Hence, a user may have to work with multiple tools to solve different use cases, thereby creating dependency on multiple vendors.
• Versatile endpoint coverage: An organization may have sources spread across applications, databases or data lakes. The SDK should be able to support distinct interfaces such as REST, JDBC or 3^rd party libraries, which is generally not the case. 

INFAConnect provides a self-service interface that radically simplifies how you build and customize connectors to meet your specific needs. Essentially, INFAConnect is a service within Informatica Intelligent Data Management Cloud (IDMC) through which you can develop, deploy and manage your connector. For building the connector, a low code and wizard-driven toolkit called ‘INFAConnect SDK’ is used.

The SDK provides wizard-driven auto code generation and test case generation capability allowing you to build a connector (supporting both read and write capabilities) in minutes. The SDK consists of libraries, plug-ins and sample code to assist you in developing connectors for IDMC. It supports the endpoints that are based on REST and JDBC interfaces. 

Now let us explore the key steps involved in building a custom connector using INFAConnect.

1. Connector Registration: First, you will need to register a name for your connector. This will ensure that the connector name is reserved across the Informatica ecosystem.
2. Connector Development: Once the connector name has been reserved, you can start developing your custom connector using the SDK. Its wizard-driven design guides you through the process and will auto-generate the connector code per your selected configurations.
3. Testing and Validation: Thoroughly testing your custom connector is crucial. INFAConnect SDK provides the capability to auto-generate test cases for your connector, ranging from unit to integration cases for both read and write scenarios. This ensures that your connector can successfully fetch and synchronize data from your specific source.
4. Deployment: Once the connector has been tested, you can deploy the connector from your sandbox to the production environment. Once deployed on IDMC Production Pods, the connector becomes available for consumption.
5. Documentation: Well-documented connectors are invaluable for efficient data integration. Create comprehensive documentation for your custom connector, making it accessible and easy for your team members to utilize.

Informatica is renowned for its user-friendly and feature-rich cloud data integration capabilities. While it boasts an impressive library of pre-built connectors, the real magic happens when data professionals leverage INFAConnect to create custom connectors. This opens doors to a myriad of possibilities including:

• Data Source Flexibility: You can connect to a wide range of data sources, whether it's a proprietary system, an industry-specific application or database, or any other unique data source that isn't covered by pre-built connectors.
• Data Transformation Control: You have complete control over how data is transformed, ensuring it aligns with your specific requirements and standards.
• Collaboration and Contribution: Consider contributing your custom connector to the INFAConnect community which fosters collaboration and helps others facing similar data integration challenges.
• Future-Proofing: You can adapt and update your custom connectors as your data landscape evolves, ensuring you always have access to critical data sources.

INFAConnect empowers data professionals to tackle the most challenging data integration tasks. Its flexibility and openness enable organizations to create tailored solutions for their unique data sources and transformations. By embracing custom connector development, you can unlock the full potential of your data integration strategy and ensure your organization stays competitive in the data-driven world.

INFAConnect is in public preview currently and if you would like to explore more, please reach out to INFAConnect team.