Last week, the team led the research to Kerberos, to be used in our large cluster, and the research task was assigned to me. This week's words were probably done with a test cluster. So far the research is still relatively rough, many online data are CDH clusters, and our cluster is not used CDH, so in the process of integrating Kerberos there are some differences.
The test environment is a cluster of 5 mac
Apache Hadoop configuration Kerberos Guide
Generally, the security of a Hadoop cluster is guaranteed using kerberos. After Kerberos is enabled, you must perform authentication. After verification, you can use the GRANT/REVOKE statement to control role-based access. This arti
Deploy Hbase in the Hadoop cluster and enable kerberos
System: LXC-CentOS6.3 x86_64
Hadoop version: cdh5.0.1 (manmual installation, cloudera-manager not installed)
Existing Cluster Environment: node * 6; jdk1.7.0 _ 55; zookeeper and hdfs (HA) installed), yarn, historyserver, and httpfs, and kerberos is enabled (kdc is
Most Hadoop clusters adopt Kerberos as the authentication protocolInstalling the KDC
Starting Kerberos authentication requires the installation of the KDC server and the necessary software. The command to install the KDC can be executed on any machine.
Yum-y Install krb5-server krb5-lib krb5-auth-dialog krb5-workstation
Next, install the
Kerberos is a security authentication protocol intended to provide
More secure authentication
Simplified management of password
Convenience of single
The basic structure of Kerberos
Kerberos Client: The party requesting the service
Kerberized Service: The party providing the services
Ker
Today, trying to configure Kerberos on the Hadoop 2.x development cluster, I've encountered some problems and recorded
Set up Hadoop security
Core-site.xml
Hadoop.security.authentication default is simple, that is, based on the Linux operating system authentication method, the client calls the WhoAmI command, and then RPC call to the server, It is easy
, and there is no dependency, you can continue with this section. Otherwise can jump to the following sectionStart > All Programs > AccessoriesLaunch a Command Prompt as an administratorTo add the dependency, type the following command: "SC config c2wts depend= cryptsvc"Note that a space was required between the equal sign and the valueYou can then go back to the Services list and check for the ' Claims to Windows Token ' service that the dependency have been Added SharePoint 2013 Platform
As the saying goes, everything starts hard. In software development, environment deployment is the first threshold. In MRv1 mode, cdh5.0.2.tar.gz is successfully integrated with Kerberos Security Authentication and is in full-distributed mode. After this installation process, we have a deep understanding of hadoop. Now, after you build the ring
As the saying goes, everything starts hard. In software develop
authenticated user
3.2.3 Certified User
Kinit-kt/xx/xx/kerberos.keytab HDFS/HADOOP1
3.2.4 deletes the current authenticated cache
Kdestroy
3.3 FAQ
3.3.1 See if ticket is renewable
View through the klist command
If the value of the valid starting is the same as the renew until, the principal of the ticket is not renwable.
3.3.2 Ticket cannot be updated
If you pass the expires, you can update the ticket by command Kinit–rBut if ticket cannot update
[root@vmw201 ~]$ kinit-r
k
The Microsoft Windows Server 2003 operating system implements the authentication protocol for Kerberos version 5. Windows Server 2003 also extends public key authentication. The client for Kerberos authentication is implemented as a SSP (security support provider) that can be accessed through SSPI (Security Support Provider Interface. Initial User Authentication was integrated with Winlogon's Single Sign-On
From: http://technet.microsoft.com/zh-cn/magazine/ee914605.aspx
Although SharePoint provides multiple authentication options and authentication regions, the two most common options implemented by enterprises in the Intranet solution are NTLM and Kerberos. Both protocols are used to integrate Windows Authentication in a typical question/response solution. NTLM relies on IIS to generate a token during the Query Process, send the token to the cli
(from cache or ticket). In such cases, it's prudent to throw a runtime exception if we receive a saslexception from the underlying Authenticati On implementation, so there are no retry from the other high level (for eg, HCM or hbaseadmin).
Other than that:[Org.apache.hadoop.security.UserGroupInformation] not attempting to re-login since the last Re-login is attempted less th An seconds before.This error is actually caused by a hard code value in Usergroupinformation, min_time_before_relogi
Http://blog.163.com/jobshot/blog/static/947091982008118105524719/
I. Basic Principles
Authentication solves the problem of "how to prove that a person is indeed the one he or she claims. For how to authentication, we adopt this method: If a secret exists only in A and B, then one person claims to B that he is, B asks a to provide this secret to prove that this person is the he or she claims. This process actually involves three important aspects about authentication:
How to express
A few days ago in explaining how Windows was authentication through Kerberos, it was a long time to talk about the man and almost put himself in. Then think of the following two points: for a person who does not fully understand Kerberos, the whole authentication process of Kerberos does not really understand--a moment to encrypt this key, and then another key to
BackgroundToday, when using JAVAAPI to connect sqoop1.99.7, I encountered an error.The error message is as follows:0 [main] WARN org.apache.hadoop.util.nativecodeloader-unable to load Native-hadoop library for your platform ... using Builtin-java classes where applicableexception in thread "main" org.apache.sqoop.common.SqoopException:CLIENT_0004: Unable to find valid Kerberos ticket cache (kinit) at Org.ap
KerberosThe Kerberos protocol is primarily used for the identification of computer networks (authentication), which is characterized by the ability for a user to enter authentication information to access multiple services (Ticket-granting ticket) with this authentication, which is SSO ( ON). Because a shared secret is established between each client and service, the protocol is quite secure.conditionsFirst look at the prerequisites for the
Today, trying to configure Kerberos on the Hadoop 2.x development cluster, I've encountered some problems and recorded
Set up Hadoop security
Core-site.xml
Hadoop.security.authentication default is simple, that is, based on the Linux operating system authentication method, the client calls the WhoAmI command, and then RPC call to the server, It is easy for
in this article we will cover the entire process of configuring an NFS share based on Kerberos authentication. Suppose you have configured an NFS server and a client. If not, you can refer to installing and configuring server for NFS [2]-it lists the dependent packages that need to be installed and explains how to initialize the configuration on the server before proceeding to the next step. In addition, you may also need to configure SELinux[3] and F
1 August 2010 22:07:51The conversation about Kerberos (MIT)Athena and ZeusAthena and Zeus ' dialogue on the keeper of the Gates of HellKerberos:network Authentication ProtocolThe term Kerberos is derived from the Greek mythology "three-head dog-the gate Keeper of Hell" Kerberos is a network authentication protocol designed to provide a powerful authentication ser
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.