Summary of common Hadoop and Ceph commands

Summary of common Hadoop and Ceph commands
It is very practical to summarize the commonly used Hadoop and Ceph commands.


Hadoop
Check whether the nm is alive. bin/yarn node list deletes the directory and hadoop dfs-rm-r/directory.
Hadoop classpath allows you to view the paths of all classes.
Hadoop leave safe mode method: hadoop dfsadmin-safemode leave wordcount program: generate random text bin/hadoop jar hadoop-mapreduce-examples-2.4.1.jar randomtextwriter-Dmapreduce. randomtextwriter. totalbytes = 8589934592/usr/mrinput wordcount test time bin/hadoop jar hadoop-mapreduce-examples-2.4.1.jar wordcount/usr/mrinput/usr/mroutput terasort program: generate the data to be sorted bin/hadoop jar hadoop-mapreduce-examples-2.4.1.jar teragen 4589934592 terasort/2-input terasort run hadoop jar hadoop-mapreduce-examples-2.4.1.jar terasort-Dmapred. reduce. tasks = 4 terasort/2-input terasort/1G-outputs

Ceph
David's script:

Mount ceph File System sudo mount. ceph 10.196.131.238: 6789 :/~ /-O name = admin, secret = AQDFWMBVuwkXARAA/O8kdBTVoCuterXiRMtmrg =
Create a cephfs, ceph fs new cephfs hadoop1 hadoop2
Rados-p poolname ls can be used to view the objects. Rados-p hadoop2 stat 0000000000d. 00000b2a allows you to view the object information.
Create pool: ceph osd pool create hadoop1 1320 1320 view pool list: ceph osd pool ls set pool size ceph osd pool set hadoop1 size 3
Ceph osd tree View osd list information ceph mds add_pool hadoop2
Ceph mds rm 0 mds. tdw-xxx mds gid 0 dne
How to delete a cephfs: sudo/etc/init. d/ceph stop mds. c223
Ceph mds rm 0 mds. c223
Ceph mds newfs 1 2 -- yes-I-really-mean-it
Ceph fs rm cephfs -- yes-I-really-mean-it
Sudo ceph osd pool delete cephfs_data -- yes-I-really-mean-it
Sudo ceph osd pool delete cephfs_metadata -- yes-I-really-mean-it
View the auth list, ceph auth list
Modify the permission to access mds in client. admin: cephauthcapsclient. adminmon 'Allow * 'mds 'Allow * 'ossd' allow *'
Updatedcapsforclient. admin
Cephtellmds. tdw-xxxinjectargs ---- debug-mds-log20 ceph tell mds. tdw-xxx injectargs -- debug-mds 20
OS sgdisk-Z/dev/sdk can clear sdk Information
Uuidgen can generate a unique id
Install rzsz yum install lrzsz to check which packages have been installed on yum list installed to check which paths the package has been installed in yum-ql cephfs-java