Question guide: The port of the HTTP service of 1.DataNode, and the port of IPC service. The port of the HTTP service for 2.NameNode, and the port of the IPC service, respectively. The port of the HTTP service for 3.journalnode, and the port of the IPC service, respectively. Which is the HTTP service port for 4.ResourceManager. Which is the HTTP service port for 5.NodeManager. The port of the HTTP service for 6.Master, and the port of the IPC service, respectively. 7.3888 is the port that is used to do what. Extension: Hadoop1. X which corresponds to the port. 9000, 9001, respectively, corresponds to the HADOOP2. The port of the X.
The parts of a Hadoop cluster are typically used for multiple ports, some for interaction between daemon, and some for RPC access and HTTP access. And with the increase of the peripheral components of Hadoop, it is completely unable to remember which port corresponds to which application, especially collect records so as to query. This includes the components we use: HDFS, YARN, HBase, Hive, ZooKeeper:
Component |
Node |
Default port |
Configuration |
Description of Use |
Hdfs |
DataNode |
50010 |
Dfs.datanode.address |
Datanode service port for data transfer |
Hdfs |
DataNode |
50075 |
Dfs.datanode.http.address |
Port for HTTP Service |
Hdfs |
DataNode |
50475 |
Dfs.datanode.https.address |
Ports for HTTPS services |
Hdfs |
DataNode |
50020 |
Dfs.datanode.ipc.address |
Ports for IPC Services |
Hdfs |
NameNode |
50070 |
Dfs.namenode.http-address |
Port for HTTP Service |
Hdfs |
NameNode |
50470 |
Dfs.namenode.https-address |
Ports for HTTPS services |
Hdfs |
NameNode |
8020 |
Fs.defaultfs |
The RPC port that receives the client connection for obtaining file system metadata information. |
Hdfs |
Journalnode |
8485 |
Dfs.journalnode.rpc-address |
RPC Service |
Hdfs |
Journalnode |
8480 |
Dfs.journalnode.http-address |
HTTP Service |
Hdfs |
Zkfc |
8019 |
Dfs.ha.zkfc.port |
ZooKeeper Failovercontroller, for nn HA |
YARN |
ResourceManager |
8032 |
Yarn.resourcemanager.address |
RM Applications Manager (ASM) port |
YARN |
ResourceManager |
8030 |
Yarn.resourcemanager.scheduler.address |
IPC Port for Scheduler components |
YARN |
ResourceManager |
8031 |
Yarn.resourcemanager.resource-tracker.address |
Ipc |
YARN |
ResourceManager |
8033 |
Yarn.resourcemanager.admin.address |
Ipc |
YARN |
ResourceManager |
8088 |
Yarn.resourcemanager.webapp.address |
HTTP Service Port |
YARN |
NodeManager |
8040 |
Yarn.nodemanager.localizer.address |
Localizer IPC |
YARN |
NodeManager |
8042 |
Yarn.nodemanager.webapp.address |
HTTP Service Port |
YARN |
NodeManager |
8041 |
Yarn.nodemanager.address |
Port of container Manager in NM |
YARN |
Jobhistory Server |
10020 |
Mapreduce.jobhistory.address |
Ipc |
YARN |
Jobhistory Server |
19888 |
Mapreduce.jobhistory.webapp.address |
HTTP Service Port |
HBase |
Master |
60000 |
Hbase.master.port |
Ipc |
HBase |
Master |
60010 |
Hbase.master.info.port |
HTTP Service Port |
HBase |
Regionserver |
60020 |
Hbase.regionserver.port |
Ipc |
HBase |
Regionserver |
60030 |
Hbase.regionserver.info.port |
HTTP Service Port |
HBase |
Hquorumpeer |
2181 |
Hbase.zookeeper.property.clientPort |
Hbase-managed ZK mode, using a standalone zookeeper cluster will not enable the port. |
HBase |
Hquorumpeer |
2888 |
Hbase.zookeeper.peerport |
Hbase-managed ZK mode, using a standalone zookeeper cluster will not enable the port. |
HBase |
Hquorumpeer |
3888 |
Hbase.zookeeper.leaderport |
Hbase-managed ZK mode, using a standalone zookeeper cluster will not enable the port. |
Hive |
metastore |
9083 |
/etc/default/hive-metastore in export port=<port> to more New default port |
|