Embracing big data-hdinsight Installation

Big Data is so real that we are getting closer and closer. You no longer need complicated Linux operations. Embrace hadoop-hdinsight on Windows. Hdinsight is 100% compatible with Apache hadoop on a Windows platform. In addition, Microsoft provides full technical support for it. Let's join in the world of big data.

Currently, hdinsight is available in two versions:

On-premises, hdinsight Server

Cloud, hdinsight Service

Currently, hdinsight service is not open for use. You need to apply for an invitation. Therefore, we use hdinsight server to experience the power of big data.

Installation
======================================

Currently, hdinsight installation is implemented through web platform Installer. You don't have to worry about all dependencies. All these installers are ready for you. One thing we must note is that, in fact, the installer will install two major components, hortonworks Data Platform for Windows and Microsoft hdinsight. Other required components, such as IIS, will be automatically installed by the installer. By default
When hdinsight is installed on server 2012, the following components are installed:

Let's discuss respectively what they are:

Hortonworks Data Platform Installer

This mis contains the core implementation of hadoop (such as map/reduce and HDFS), and other Apache projects in the hadoop ecosystem. Below is a complete list:

· Map reduce

· HDFS

· Hive

· Pig

· Hcatalog

Each project is packaged into a zip file, which contains a powershell script for installation.

Microsoft hdinsight Installer

This MSI contains some components related to Microsoft's implementation. It currently includes:

· Hdinsight dashboard

· Sqoop

· Isotope. js

· Getting started content

The packaging method of these components is similar to that of the hadoop project above. In addition, it provides a powershell script that can be used to initialize and install, such as to start the hadoop component service.

 

Special Installation Considerations for Chinese users

Are you ready to try the installation? Please wait! Due to the current beta version, there are still some problems with the hdinsight server downloaded on the Microsoft website, which may cause installation failure. If you use Chinese characters to parse non-Unicode characters by default on your computer, you will not see any hadoop service after installation. After analyzing the Installation Log, I found that
User Failed, but why? After analyzing a large number of installation scripts, I found that the installation failed due to a non-Unicode Character in the installation script. In the create_hadoop_user.ps1 script in c: \ hadoopinstallfiles \ hadooppackages \ hdp-1.0.1-winpkg.zip \ scripts, you can see the following lines:

$ Export. psobject. typenames. insert (0, export xportedpscredential?

Is to change the line, causing the installation to fail.

The correct rows should be:

$ Export. psobject. typenames. insert (0, 'exportedpscredential ')

To ensure successful installation, we recommend that you change region setting of Windows server to English (United Stats)

The installation is complete.

 

After the installation is complete, you can see the following icon on the desktop:

 

Click Microsoft hdinsight dashboard. If you see the following page, congratulations, the installation is successful:

 

How is it? Do you want to give it a try?

 

From: http://blogs.msdn.com/ B /apgcdsd/archive/2013/04/10/hdinsight.aspx