Display: An internal error occurred while querying Service Monitor (Error sending messages to firehose:mgmt-servicemonitor-)1. Initial row detection is Smon service port 9999 and Firehose Port 9998 is not availableNo, it's normal.2. Debug Web (the
In order to achieve near real-time search, there must be a mechanism to process the data in real time and then generate to the SOLR index, flume-ng just provide a mechanism, it can collect data in real time, and then through Morphlinesolrsink to the
Originally is to see this topic is the courseware recommended topic among the highest AC rate, the results also looked at two days to see understand t^t, three-state compression, what the devil, a DP Incredibly also 100 lines of code, too outrageous
Cloudera's QuickStart VM-installation-free and configuration-free Hadoop Development Environment
Cloudera's QuickStart VM is a virtual machine environment that helps you build CDH 5.x, Hadoop, and Eclipse for Linux and Hadoop without installation
Installation version
hadoop-2.0.0-cdh4.2.0hbase-0.94.2-cdh4.2.0hive-0.10.0-cdh4.2.0jdk1.6.0_38Instructions before installation
The installation directory is/OPT.
Check the hosts file
Disable Firewall
Set Clock Synchronization
Instructions for
Ii. Installing Hadoop and the services it needs1. CDH Installation OverviewCDH's full name is Cloudera's distribution including Apache Hadoop, a Hadoop distribution version of Cloudera Corporation. There are three ways of installing CDH:. Path A-Automatic installation via Cloudera Manager. Path B-Installation using Cloudera Manager parcels or packages. Path C-Man
comprehensive release.
2.3.4 download path
Based on the above considerations, we recommend that you use the latest version of cdhx (equivalent to the stable version of Apache hadoop) at http://archive.cloudera.com/cdh5/cdh/5 /.2.4 introduction to the release version of hortonworks hadoop
HDP is a relatively new version, which is basically synchronized with Apache at present, because most employees in hortonworks are contributors to Apache Code, especially those of hadoop 2.0.
Note:
[1]
The OS version is centos6.5, And the 64-bit JDK 1.6 also supports python 2.6 or later versions of JDK 1.7. Before installation, disable serviceiptablesstopchkconfigiptablesoff to disable SELINUXvietcselin.
Version Conventions: operating system version centos6.5, the 64-bit jdk1.6 version also supports jdk1.7 python version 2.6 or 2.7 cluster version cdh5.3.2 cloudera manager 5.3 mysql5.0 or later versions. Before installation, the firewall is disabled
and configure it to use port 80.
After configuring the http server, you can configure path addresses in the "http: //" format in the yum source, for example:
Baseurl = Signature:
Second hurdle: cloudera console installation error-Incorrect http path
After configuring the yum source and executing the binfile on the cloudera console, the following error is returned:
View the error log as prompted:
[Root @ m
1. Prepare Ubuntu offline source and configure/etc/apt/source. listPrepare Cloudera Hadoop offline source and configure/etc/apt/source. list. d/cloudera. list. Synchronize/etc/hosts of the Cluster Ssh password-free logon. The machine on which cloudera-scm-server is located can log on to other cloudera-scm-agent machi
operations:
Disable Firewall
Chkconfig iptables off
Service iptables stop
You must set selinux = disabled in/etc/SELINUX/config through Cloudera Manager installer. You need to restart the machine.
Sed-I "s/SELINUX = enforcing/SELINUX = disabled/g"/etc/selinux/config
Configure sohu source 163
Cd/etc/yum. repos. d/
# Centos5
Wget? Http://mirrors.163.com/.help/CentOS5-Base-163.repo
# Wget? Http://mirrors.sohu.com/help/CentOS-Base-sohu.repo
Three cluster nodes
192.168.1.170 CDH-Master
Cdh-slave-1 192.168.1.171
Cdh-slave-2 192.168.1.171
1. Install centos6.5 (64-bit) and set up the basic environment, including:
(1) Add sudo Permissions
(2) modify the host name, gateway, static IP address, and DNS
(3) Disable SELinux and Firewall
Refer to the article
(4) modify the system time zone and configure the NTP service (select the host machine to configure the NTP server, refer to the article)
2. Clone the three hosts and modify static IP add
http://blog.csdn.net/wulantian/article/details/42706777CDH5. x Full Uninstall Step # by coco# 2015-01-141. Close all services in the cluster.This can be done by Clouder Manger home page to close the cluster.2. Uninstall [[email protected] ~]#/usr/share/cmf/uninstall-cloudera-manager.sh Note: If uninstall-cloudera-manager.sh is not installed in the cluster, uninstall it using the following command: a, sto
Recent projects need to use Oozie Workflow scheduling hivesql, found unable to execute query statements, see: https://community.cloudera.com/t5/Batch-Processing-and-Workflow/ oozie-hive-action-failed-with-wrong-tmp-path/td-p/37443 this, the culprit is CDH bug, need to upgrade the version.Upgrade steps:1. Querying a service on a single nodeService--status-allFound only cloudera-scm-agent, no cloudera-scm-ser
1, it is in the installation of CDH can not be installed successfully, only restart, the following to share an artifact, according to this script should be almost able to uninstall clean, and then reinstall, write a script, the content is as follows, life-saving artifact:#!/bin/Bashsudo/usr/share/cmf/uninstall-cloudera-Manager.shsudo Service Cloudera-scm-Server Stopsudo Service
Impala online documentation describes Impala ODBC interface installation and configuration http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/Impala/ Installing-and-using-impala/ciiu_impala_odbc.html Impala ODBC Driver: http://www.cloudera.com/content/support/en/downloads/connectors.html This paper explains the installation and use of Impala ODBC in centos-6.5-x86_64 environment. F
Install cloudera-managerin go.cloudera.comcloudera-standard-download.html download the cloudera-manager-installer.bin after downloading it to set the Execute Permission chmod + x. cloudera-manager-installer.bin to run with root permission, sudo ?. Cloudera-manager-installer.bin step by step
Install
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.