At the Strata Conference + Hadoop World 2013, Informatica Corporation (Nasdaq:INFA), the world’s number one independent provider of data integration software, announced a new streaming data collection technology, called Informatica Vibe Data Stream for Machine Data, which will simplify big data collection of machine data from many sources and its delivery to Hadoop, and a wide range of other targets, over any geographic boundary.
Informatica Vibe Data Stream for Machine Data makes high-volume, high-velocity and high-scale streaming data collection available, for the first time, and is built on the industry’s fastest and highest performing messaging technology. Customers deploying Informatica’s easy-to-use and configure, cost-effective Vibe Data Stream for Machine Data software will have a unique and powerful way to deliver holistic operational intelligence across the enterprise by collecting previously difficult to access data.
Informatica Vibe Data Stream for Machine Data is a key new component of Informatica’s end-to-end data integration platform, powered by Informatica Vibe, the industry’s first and only embeddable virtual data machine (VDM). Informatica Vibe Data Stream uses embeddable Vibe agents to collect data in real-time and stream millions of records per second into big data platforms such as Hadoop and Cassandra. Informatica Vibe Data Stream also streams data directly into Informatica PowerCenter and Informatica CEP, enabling real-time event processing and analytics.
“Vibe Data Stream provides efficient, high-performance streaming data collection from sensors, mobile devices, log files, and generally machine data from the Internet of Things,” said Ash Kulkarni, senior vice president and general manager, Data Integration, Informatica. “This technology easily delivers previously difficult to collect data directly to targets in real-time, enabling companies to find deeper insights in this type of machine-generated big data.”
Many companies and industries need to efficiently perform high-volume, high-velocity and high-scale streaming data collection over Local Area Network (LAN) and Wide Area Network (WAN) environments – to enable real-time, big data analytics and operational intelligence.
However, current architectures to achieve this require large amounts of infrastructure resources, including servers and storage, and high levels of software development expertise. Consequently, this ability currently is beyond the reach of many companies. Also, competing solutions require additional coding or development to approximate the capabilities of Informatica’s Vibe Data Stream for Machine Data technology, and those solutions typically lack the performance, reliability, efficiency and ease-of-use of Vibe Data Stream for Machine Data.
Informatica’s Vibe Data Stream for Machine Data technology meets this challenge by making reliable, high-throughput streaming data collection broadly available to many companies through enterprise-class, easy-to-configure, cost-effective software. A centralized interface enables simplified set-up, deployment, administration and monitoring. Flexible configurations can be created for a variety of source to target patterns.
Customers can take advantage of Informatica Vibe Data Stream for Machine Data technology by deploying data collectors (i.e., Vibe agents) on various sources, which then provide streaming data collection and distribution through a high-performance messaging technology based on Informatica Ultra Messaging. Informatica Vibe Data Stream for Machine Data delivers the data directly to multiple targets for either stream processing (for real-time analytics) or batch processing (for big data analytics and transactional applications).
According to a July 31, 2013 Gartner report, Hype Cycle for Big Data, 2013, “As companies implement more big data solutions, the need to use high-performance message delivery with those solutions will grow. Moreover, the demands of real-time systems, particularly the Internet of Things, mobile devices and world-class cloud applications, will drive adoption of high-performance message delivery, even when big data database technology is not involved.”1
Customers in the logistics, transportation and manufacturing industries, for example, could use Informatica Vibe Data Stream for Machine Data technology for device, sensor or machine data collection. Web entities or retail operations could take advantage of Informatica Vibe Data Stream for Machine Data for Web log data, and telecommunications network operators and utilities could use Vibe Data Stream for Machine Data for network or switch data.
Informatica currently is conducting customer trials of its Vibe Data Stream for Machine Data technology and plans to make it generally available later in Q4. The company also will provide, later in Q4, a software development kit (SDK), which customers can use to develop agents for custom sources and targets.
Visit Informatica at Kiosk 63 at the Strata Conference + Hadoop World 2013, Oct. 28-30 at the New York Hilton Midtown.
Tweet this: News @InformaticaCorp Vibe Data Stream for Machine Data Plugs #Hadoop Into The #InternetofThings http://bit.ly/16B5fY2 #VibeVDM #IoT
“At Cloudera, we’re seeing customers across industries come to depend on Hadoop-based platforms to create enterprise data hubs for Big Data projects,” said Charles Zedlewski, vice president, Products, Cloudera. “This new offering from Informatica will help organizations capture the value of all their data with an easy-to-use, powerful solution for stream data processing on Hadoop.”
“Informatica’s Vibe Data Stream for Machine Data is an important addition to the Modern Data Architecture,” said Shaun Connolly, vice president, Corporate Strategy, Hortonworks. “Vibe Data Stream for Machine Data ensures timely data delivery between Hadoop and the rest of the enterprise by providing reliable, high-volume stream data collection and support for large data distributions with high throughput and concurrency.”
“By using MapR and Informatica Vibe Data Stream for Machine Data, companies gain the benefit of enterprise-grade capabilities for real-time streaming into Hadoop,” said Jack Norris, chief marketing officer, MapR. “This enables highly available, efficient, and reliable real-time data collection and streaming across a wide variety of data sources over local and wide area networks.”
“We’re excited about the high-performance, real-time data collection and streaming capabilities that Vibe represents,” said Todd Paoletti, vice president, Product Marketing, Pivotal, Inc. “Our Pivotal HD customers will, indeed, find great advantages as they develop, deploy and maintain real-time big data applications.”