hadoop2.x common port, definition method and default port, Hadoop1. X-Port comparison

Question guide: The port of the HTTP service of 1.DataNode, and the port of IPC service. The port of the HTTP service for 2.NameNode, and the port of the IPC service, respectively. The port of the HTTP service for 3.journalnode, and the port of the IPC service, respectively. Which is the HTTP service port for 4.ResourceManager. Which is the HTTP service port for 5.NodeManager. The port of the HTTP service for 6.Master, and the port of the IPC service, respectively. 7.3888 is the port that is used to do what. Extension: Hadoop1. X which corresponds to the port. 9000, 9001, respectively, corresponds to the HADOOP2. The port of the X.


The parts of a Hadoop cluster are typically used for multiple ports, some for interaction between daemon, and some for RPC access and HTTP access. And with the increase of the peripheral components of Hadoop, it is completely unable to remember which port corresponds to which application, especially collect records so as to query. This includes the components we use: HDFS, YARN, HBase, Hive, ZooKeeper:

Component	Node	Default port	Configuration	Description of Use
Hdfs	DataNode	50010	Dfs.datanode.address	Datanode service port for data transfer
Hdfs	DataNode	50075	Dfs.datanode.http.address	Port for HTTP Service
Hdfs	DataNode	50475	Dfs.datanode.https.address	Ports for HTTPS services
Hdfs	DataNode	50020	Dfs.datanode.ipc.address	Ports for IPC Services
Hdfs	NameNode	50070	Dfs.namenode.http-address	Port for HTTP Service
Hdfs	NameNode	50470	Dfs.namenode.https-address	Ports for HTTPS services
Hdfs	NameNode	8020	Fs.defaultfs	The RPC port that receives the client connection for obtaining file system metadata information.
Hdfs	Journalnode	8485	Dfs.journalnode.rpc-address	RPC Service
Hdfs	Journalnode	8480	Dfs.journalnode.http-address	HTTP Service
Hdfs	Zkfc	8019	Dfs.ha.zkfc.port	ZooKeeper Failovercontroller, for nn HA
YARN	ResourceManager	8032	Yarn.resourcemanager.address	RM Applications Manager (ASM) port
YARN	ResourceManager	8030	Yarn.resourcemanager.scheduler.address	IPC Port for Scheduler components
YARN	ResourceManager	8031	Yarn.resourcemanager.resource-tracker.address	Ipc
YARN	ResourceManager	8033	Yarn.resourcemanager.admin.address	Ipc
YARN	ResourceManager	8088	Yarn.resourcemanager.webapp.address	HTTP Service Port
YARN	NodeManager	8040	Yarn.nodemanager.localizer.address	Localizer IPC
YARN	NodeManager	8042	Yarn.nodemanager.webapp.address	HTTP Service Port
YARN	NodeManager	8041	Yarn.nodemanager.address	Port of container Manager in NM
YARN	Jobhistory Server	10020	Mapreduce.jobhistory.address	Ipc
YARN	Jobhistory Server	19888	Mapreduce.jobhistory.webapp.address	HTTP Service Port
HBase	Master	60000	Hbase.master.port	Ipc
HBase	Master	60010	Hbase.master.info.port	HTTP Service Port
HBase	Regionserver	60020	Hbase.regionserver.port	Ipc
HBase	Regionserver	60030	Hbase.regionserver.info.port	HTTP Service Port
HBase	Hquorumpeer	2181	Hbase.zookeeper.property.clientPort	Hbase-managed ZK mode, using a standalone zookeeper cluster will not enable the port.
HBase	Hquorumpeer	2888	Hbase.zookeeper.peerport	Hbase-managed ZK mode, using a standalone zookeeper cluster will not enable the port.
HBase	Hquorumpeer	3888	Hbase.zookeeper.leaderport	Hbase-managed ZK mode, using a standalone zookeeper cluster will not enable the port.
Hive	metastore	9083	/etc/default/hive-metastore in export port=<port> to more New default port