Integration and monitoring of splunk implementation and Hadoop

October 24, 2012, real-time operations information software provider Splunk announced that Splunk Hadoop Connect and Splunk App for Hadoopops are now fully listed. Splunk Hadoop Connect provides bidirectional integration to easily and reliably migrate data between Splunk and Hadoop. Splunk App for Hadoopops allows real-time monitoring and analysis of the health and performance of the End-to-end Hadoop environment. Splunk Hadoop Connect and Splunk App for hadoopops are available for download.

"Splunk Hadoop connect makes it easier for Hadoop users to use Splunk to bring large data into the enterprise," said Arun Murthy, chairman of the Apache Hadoop Project Management Committee. It allows Splunk and Hadoop to be more tightly connected, opening up unlimited possibilities for users. The key technical factor for Hadoop's future development is software that uses Hadoop to get information from data. ”

"We continue to transfer data to Splunk to support our operations, applications, security teams and executives and provide them with information," said John Martin, senior director of Edmunds.com production engineering. We also deploy Hadoop for multiple batches. The integration of Splunk and Hadoop allows us to take full advantage of both technologies and ensure that our Hadoop cluster runs smoothly. ”

Splunk Hadoop Connect allows enterprises to fully enjoy the technology of two companies. Rapid deployment Splunk Real-time collection, retrieval, analysis, and visualization, and then reliably forwards events to Hadoop for long-term archiving and more batch analysis. Enterprise organizations can make the best use of splunk by importing data stored in Hadoop to easily build reliable, secure, enterprise-wide data projects within a few days. Splunk Hadoop Connect is compatible with Apache Hadoop and has been tested and certified by Cloudera CDH and Hortonworks HDP.

Splunk APP for Hadoopops provides real-time end-to-end monitoring, analysis, and troubleshooting for Hadoop, all of which are done in one interface. Existing Hadoop monitoring tools focus on the Hadoop layer only. Splunk App for Hadoopops enables transcendence by covering infrastructure, including Hadoop, networks, switches, racks, operating systems, and databases.

Sanjay Mehta, vice president of Splunk's product marketing, said: "By translating large data into real-time intelligence, Splunk customers bring us surprises every day." We want to make it easier for Hadoop users to get that value. Splunk can collect, analyze and secure the data generated by users ' machines in a relaxed, rapid and flexible manner, whether in physical, virtual, or cloud environments. Splunk Hadoop Connect and Splunk App for Hadoopops have a common development goal: to help Hadoop users get more from their data while managing and monitoring their systems more easily. ”

"Splunk uses a methodological approach to define its coexistence with Hadoop," said Matt Aslett, director of data management and analysis at 451 Research. Splunk Hadoop Connect not only integrates with Hadoop, but also interacts with it, plus using Splunk App for Hadoopops to monitor cluster resources beyond Hadoop itself, meaning it can Provides a greater role in managing and analyzing a single platform for data in Splunk and Hadoop. ”

The Splunk Hadoop Connect feature includes:

Reliably export events from Splunk Enterprise to Hadoop for archiving, further processing, or more batch processing. The raw data and the data before processing can be sent.

Using the Splunk Hadoop Connect user interface to explore the Hadoop directory, check the file and decide to import the Splunk data.

Import Hadoop data into Splunk and retrieve it for search, reporting, analysis, visualization, and protection through role-based access control.

Splunk App for Hadoopops features include:

In addition to multiple cluster management from different data centers, you can also monitor Hadoop clusters, databases, and networks End-to-end and troubleshoot problems.

A powerful alert framework for any warning or error situation.

View the Hadoop nodes in real time, using an intuitive heat map display.

Analyze MapReduce's real-time and historical performance.

Splunk Hadoop Connect and Splunk App for Hadoopops can be downloaded for free on splunkbase.

Clearly, Splunk's integration and monitoring of Hadoop has enriched the Hadoop industry chain from the periphery. Not only is splunk, there are splice machine,birst (see expanding Hadoop category), such as a group of technology innovation-oriented enterprises.

(Responsible editor: The good of the Legacy)