[[+content_image]]
N
N
Nikolay Baranenko2017-10-14 01:55:23
big data
Nikolay Baranenko, 2017-10-14 01:55:23

How to check the status of the slave nodes of the hadoop cluster?

Hello.
I have 3 virtual machines on CentOS 7 with hadoop
hadoop01 - master
hadoop02 - slave1
hadoop03 - slave2
start master

[[email protected] ~]$ hadoop-daemon.sh --config /app/hadoop/etc/hadoop --script hdfs start namenode
starting namenode, logging to /app/hadoop/logs/hadoop-hadoop-namenode-hadoop01.out
[[email protected] ~]$ hadoop-daemon.sh --config /app/hadoop/etc/hadoop --script hdfs start datanode
starting datanode, logging to /app/hadoop/logs/hadoop-hadoop-datanode-hadoop01.out
[[email protected] ~]$ start-dfs.sh
17/10/13 23:43:05 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [hadoop01]
hadoop01: namenode running as process 28467. Stop it first.
hadoop03: starting datanode, logging to /app/hadoop/logs/hadoop-hadoop-datanode-hadoop03.out
hadoop02: starting datanode, logging to /app/hadoop/logs/hadoop-hadoop-datanode-hadoop02.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /app/hadoop/logs/hadoop-hadoop-secondarynamenode-hadoop01.out
17/10/13 23:43:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[[email protected] ~]$ yarn-daemon.sh --config /app/hadoop/etc/hadoop  start resourcemanager
starting resourcemanager, logging to /app/hadoop/logs/yarn-hadoop-resourcemanager-hadoop01.out
[[email protected] ~]$ yarn-daemon.sh --config /app/hadoop/etc/hadoop  start nodemanager
starting nodemanager, logging to /app/hadoop/logs/yarn-hadoop-nodemanager-hadoop01.out
[[email protected] ~]$ yarn-daemon.sh --config /app/hadoop/etc/hadoop  start proxyserver
starting proxyserver, logging to /app/hadoop/logs/yarn-hadoop-proxyserver-hadoop01.out
[[email protected] ~]$ start-yarn.sh
starting yarn daemons
resourcemanager running as process 29000. Stop it first.
hadoop02: starting nodemanager, logging to /app/hadoop/logs/yarn-hadoop-nodemanager-hadoop02.out
hadoop03: starting nodemanager, logging to /app/hadoop/logs/yarn-hadoop-nodemanager-hadoop03.out
[[email protected] ~]$ mr-jobhistory-daemon.sh --config /app/hadoop/etc/hadoop start historyserver
starting historyserver, logging to /app/hadoop/logs/mapred-hadoop-historyserver-hadoop01.out

I get the result
[[email protected] ~]$ jps
29520 JobHistoryServer
29249 NodeManager
28467 NameNode
29557 Jps
29000 ResourceManager
28555 DataNode
28862 SecondaryNameNode

I check through web
hadoop01:8088/cluster/nodes
there is one single
Cluster Metrics entry
/default-rack	RUNNING	hadoop01:46648	hadoop01:8042	Сб окт 14 01:52:45 +0300 2017		0	0 B	8 GB	0	8	2.8.1
Showing 1 to 1 of 1 entries

also for
hadoop01:50070/dfshealth.html#tab-datanode
also information only for the master
Node	Http Address	Last contact	Capacity	Blocks	Block pool used	Version
hadoop01:50010 (192.168.0.70:50010)	hadoop01:50075	2s	
64.98 GB
0	8 KB (0%)	2.8.1

Is it correct that only information about the master is displayed or should there still be information about the slave?

Answer the question

In order to leave comments, you need to log in

[[+comments_count]] answer(s)
Y
Yo!, 2017-10-16
@Yo1

from the console you can see what hdfs has:
hdfs dfsadmin -report
what is the distribution kit of hadup? for good, you need to go to the cloudera manager, ambari or whatever your distro has for administration and look at the status of the services there.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question