c01-cloud-integration-v2

Cloud Mass Ingestion

Efficiently ingest streaming big data, databases, and files with cloud-based services.

Data ingestion at the speed of business

Building new data warehouses or data lakes in the cloud is key to accelerating digital transformation—but you must also efficiently ingest data into those systems. Informatica Intelligent Cloud Services (IICS) quickly ingests data into on-premises systems, cloud repositories, and messaging hubs like Apache Kafka so it’s immediately available for real-time processing. You’ll also get support for streaming IoT and log data, large file sizes, and change data capture for databases.

 Why do I need cloud mass ingestion?

  • To efficiently move streaming data, IoT data, file data and databases onto cloud data lakes, making it easily accessible for analytics and data science initiatives.

  • To ingest change data capture (CDC) data onto cloud data warehouses such as Amazon Redshift, Snowflake, or Microsoft Azure SQL Data Warehouse so you can make decisions quickly using the most current and consistent data. 

  • To accelerate ingestion of real-time data from logs and clickstreams onto Kafka to better support microservices and real-time event processing.

 

 Make more data available for analytics with Informatica mass ingestion services

Informatica offers three cloud-based services to meet your specific data ingestion needs. Each managed and secure service includes an authoring wizard tool to help you easily create data ingestion pipelines and real-time monitoring with a comprehensive dashboard.

 

Database Ingestion

  • Ingest data from relational databases including Oracle, Microsoft SQL Server, and MySQL

  • Address change data capture needs and get support for schema drift to identify changes on the source schema and automatically apply schema changes within a running job

  • Ingest data onto data lakes such as Amazon S3 and Microsoft Azure Data Lake Storage, data warehouses such as Snowflake and Azure Synapse Analytics, and messaging hubs like Kafka

  • Support three ingestion modes: initial load (one time), incremental load (continuous), or initial plus incremental

File Ingestion

  • Transfer any size or type of file with high performance and scalability

  • Support major protocols, including Advanced FTP, SFTP, and FTPS, Amazon S3, Microsoft Azure Blob, and Azure Data Lake Storage, Google Cloud Storage, and Databricks Delta.

  • Support multiple data targets including FTP, SFTP, and FTPS; Amazon S3 and Redshift; Microsoft Azure Blob and Azure Data Lake Storage; Google Cloud Storage and BigQuery; Databricks Delta; and Snowflake

Streaming Data Ingestion

  • Collect, filter, and combine data from streaming and IoT endpoints and ingest it onto your data lake or messaging hub

  • Support data sources such as logs, clickstream, social media, Kafka, Amazon Kinesis Data Firehose, Amazon S3, Microsoft Azure Data Lake Storage, JMS, and MQTT

  • Support data targets including Kafka; Amazon S3 and Kinesis Data Firehose; and Microsoft Azure Event Hubs

How can we help?

Free Trials

Experience Intelligent Cloud Services.

Informatica Network

Find answers to your tough questions.