Splunk Hunk 6.1 Large information for accessible Hadoop and NoSQL

Add access to multiple NoSQL repositories and provide report acceleration and interactive dashboard interfaces:

For the booming large data application environment, Splunk has launched a proprietary integrated data analysis product hunk, alias Splunk Analytics for Hadoop and NoSQL data Stores, as the name suggests, It can transform the unstructured and nosql data in Hadoop and the database, quickly and easily into the information that can assist business decision making, provide the mechanism of search and analysis, and the processing ability of visualization, so as to improve the speed of information return and shorten the time of communication, in addition, The system also provides an interactive dashboard operating interface from which the user can perform the analysis function without having to move the data or fix the data outline (schema) before starting the job.

Hunk currently supports the Hadoop environment, primarily Apache Hadoop and major Hadoop versions, including first-generation MapReduce and yarn, and for NoSQL and other sources, currently supports Apache Accumulo, Apache Cassandra, Couchbase, MongoDB and neo4j.

The latest edition of the Hunk 6.1, launched in May this year, also features a new variety of functions for Hadoop and NoSQL applications. For example, the new virtual index technology is added to Splunk, so hunk can disassemble the data access and the dependencies between the analysis layer and the storage layer, so as to facilitate the hunk to guide the data access requirements to each database; Another key point is to accelerate the production of statistical analysis reports, When the results of the Hadoop search are transparently made to the cache, thus improving the response time and effectiveness of the report, without prior removal of data can be done, and with this mechanism, but also to enhance the use of Hadoop resources efficiency, without fear of data growth and the number of inquiries to increase the application trend.

The interactive dashboard and charts provided by the new hunk are also worth mentioning. This dashboard provides a new interface editor that allows users to quickly build dashboards based on the items they want, and the chart also provides cascading rendering style, pan-zoom controls, and Drill-down operations within the dashboard (drill down), with a significant increase in interactivity. Furthermore, the charts and dashboards for these statistical analyses can also be embedded in third-party commercial software.

For unstructured data processing, hunk, in addition to enhanced support for Hadoop and NoSQL data, also spans multiple formats for archival content access, 6.1 supports automatic access to plain text files, continuous files, rcfile (record columnar Files,apache Hive the format used for storing the information), ORC (optimized Row columnar,apache hive format for storage of data), and Parquet file (format for storing column data in Hadoop environment)

The 6.1 version of Hunk is also fortified with security. It joins the pass-through (pass-through) identity authentication mechanism, when the system to submit mapreduce work and access to Hadoop cluster, users can directly with the IT department of the identity and role of the user ID, to enhance the overall data access security protection.

In the context of the program development environment, hunk also provides a wealth of mechanisms to enable developers to use their familiar programming languages and frameworks, in the storage environment of the Hadoop decentralized archive system (HDFS), and in NoSQL repositories, Integrate data and related access functions into enterprise-wide data application systems.

Hunk's mechanisms include a standardized web page framework, a rest API for consolidating related files, an Eclipse plug-in, and software development kits for C #, Java, JavaScript, Python, PHP, and Ruby. Through common programming languages such as JavaScript, Django, Python, developers can also build proprietary applications with custom dashboards, interface components and data visualization mechanisms on hunk.

Hunk provides interactive dashboards and graphs, where users can use editing tools to build their own dashboard and enhance the analytics experience.

Splunk on the new hunk to add the function of the report accelerator, the search results can be stored as a cache, which can be pre-set content summary coverage of the time range, which can effectively improve the report query speed, in response to the volume of data and query volume growth.