How to Easily Ingest Application Data into Snowflake Data Cloud
At Snowflake Summit 2021, Informatica announced New Data Loading and Advanced ELT Integrations with Snowflake Data Cloud.
What are the challenges in data ingestion?
The adoption of software as a service (SaaS) and cloud applications has been increasingly rapid, and they are becoming a crucial part of organizations’ success. Many organizations have already adopted a cloud-first strategy for their next-generation application use cases. While businesses have observed multiple benefits from SaaS adoption, it has also resulted in data being spread across different SaaS systems.
Organizations face many challenges in accelerating their cloud analytics and AI and ML (machine learning) initiatives, as data is growing not only in size but also variety. Building new data warehouses or data lakes in the cloud is the key for accelerating digital transformation, but it can get awfully expensive and complicated to extract meaningful insights from data. Data engineers and data analysts have to deal with complexities while ingesting enormous volumes of data at scale from different sources–such as application data, mainframe, database, data warehouse, machine data, IOT (Internet of Things), streaming data, logs, and files–to the cloud.
With its unique architecture, Snowflake Data Cloud provides elasticity, native support for diverse data, and compelling performance at a fraction of the cost of conventional data warehouses while eliminating their complexity. However, you need a simple, easy-to-use, consistent experience to identify and bring all that data into Snowflake Data Cloud, and then manage and govern it in a way that can run on any cloud for all workloads. The success of your AI/ML and analytics modernization initiatives depends on having easy access to enterprise, trusted and high-quality data.
Seamlessly Ingest Data into Snowflake Data Cloud.
Here is how you can overcome data ingestion challenges and easily ingest all your data into Snowflake Data Cloud.
Informatica supports all your data management initiatives, including data ingestion, data synchronization, data integration, application integration, API management, and data quality with Informatica’s Intelligent Data Management Cloud (IDMC). Powered with the AI/ML-driven intelligence of the CLAIRE® engine and designed for cloud scalability with a microservices architecture, Intelligent Data Management Cloud provides critical cloud data management services, including Cloud Mass Ingestion for Snowflake Data Cloud.
You can easily ingest an enormous volume of data at scale from different sources such as application data, mainframes, databases, data warehouses, machine data, IOT, streaming data, logs, and files into Snowflake Data Cloud. You can also apply simple data transformation techniques during ingestion to ensure the data is ready for analytics.
What is new in Informatica Cloud Mass Ingestion?
Informatica’s Cloud Mass Ingestion service ingests and synchronizes data from applications such as Salesforce and SAP into Snowflake Data Cloud. The service provides a simple 4-step wizard-driven experience to enable data engineers, data analysts, and data integrators to efficiently capture, ingest, and replicate data from SaaS and on-premises application sources into Snowflake Data Cloud. Informatica Cloud Mass Ingestion enables organizations to ingest applications data easily and efficiently (while saving time and money), accelerating Snowflake Data Cloud adoption.
In addition, Cloud Mass Ingestion provides:
- 4-step Wizard Driven Experience – No hand coding—organizations can ingest and synchronize applications data using pre-built connectors in few clicks.
- Out of the box, pre-built connectors for various application sources such as Salesforce, SAP, ServiceNow, Microsoft Dynamics 365, Workday, NetSuite, Zendesk, Marketo, and Google Analytics.
- Efficient change data capture (CDC) and automated schema drift so data consumers of Snowflake Data Cloud can trust their data assets while reducing maintenance.
- Unified ingestion solution for all patterns, i.e., applications, files, databases, streaming, and IoT sources into Snowflake Data Cloud. Cloud Mass Ingestion reduces the ingestion process from hours to minutes, so you save time and money.
- Real-time monitoring and lifecycle management for efficient and faster troubleshooting.
Now, it’s easy to unlock the value of your application data
Traditionally, organizations have developed custom data pipelines for ingesting and synchronizing bulk and incremental data from application data. This custom coding is time-consuming, not scalable and needs high maintenance. The new application ingestion and synchronization capability in Informatica Cloud Mass Ingestion solves this use case by offering easy to use, simple, secure, scalable and zero maintenance service to automate SaaS data flows onto Snowflake Data Cloud.
When is it available?
The application ingestion and synchronization capability in Informatica Cloud Mass Ingestion is planned to be available in the second half of 2021. The preview of the capability is planned for the next few weeks.
Informatica and Snowflake, better together
Our customers can now accelerate their journey to the cloud and realize faster value from their application data along with other enterprise data. The power of Snowflake Data Cloud combined with Informatica’s Intelligent Data Management Cloud provides you with a comprehensive, multi-cloud and cloud-native platform to accelerate data-driven innovation and digital transformation.
Our mission is to continue to innovate together with Snowflake to help you unleash the power of your data.
