In HDFs, the default file deletion retention time is 0, that is, deleted files are not retained, the deletion is lost
So if you want to enable the HDFs Recycle Bin mechanism, after deleting the file, how long do you want the file to disappear, because in this process you want to recover the file?
<property> <name>fs.trash.interval</name> <value>1440</value> </ Property>
Add the above configuration to Core-site.xml, 1440 means the deleted file is saved for 1440 minutes, during which time you can recover your files
[[Email protected] bin]# sh hdfs dfs-ls-r/flume/events/2015/01/28/15/55-rw-r--r-- 3 root supergroup
As shown, after setting up the Recycle Bin, whenever you delete a file, it will print where the file is deleted and where to go, if you want to recover, MV will be able to
The whole process is as follows:
[[email protected] bin]# sh hdfs dfs-ls-r/flume/events/2015/01/28/15/55[[email protected] bin]# sh hdfs dfs- Ls-r/user/root/. TRASH/CURRENTDRWX-------root supergroup 0 2015-03-05 14:28/user/root/. TRASH/CURRENT/FLUMEDRWX-------root supergroup 0 2015-03-05 14:28/user/root/. TRASH/CURRENT/FLUME/EVENTSDRWX-------root supergroup 0 2015-03-05 14:28/user/root/. TRASH/CURRENT/FLUME/EVENTS/2015DRWX-------root supergroup 0 2015-03-05 14:28/user/root/. TRASH/CURRENT/FLUME/EVENTS/2015/01DRWX-------root supergroup 0 2015-03-05 14:28/user/root/. TRASH/CURRENT/FLUME/EVENTS/2015/01/28DRWX-------root supergroup 0 2015-03-05 14:28/user/root/. TRASH/CURRENT/FLUME/EVENTS/2015/01/28/15DRWX-------root supergroup 0 2015-03-05 14:28/user/root/. trash/current/flume/events/2015/01/28/15/55-rw-r--r--3 root supergroup 12207 2015-01-28 15:56/user/root/. TRASH/CURRENT/FLUME/EVENTS/2015/01/28/15/55/CMCC.1422431701282[[email protected] bin]# sh hdfs dfs-mv/user/root/. trash/current/flume/events/2015/01/28/15/55/cmcc.1422431701282/flume/events/2015/01/28/15/55[[email Protected] bin]# sh hdfs dfs-ls-r/user/root/. TRASH/CURRENTDRWX-------root supergroup 0 2015-03-05 14:28/user/root/. TRASH/CURRENT/FLUMEDRWX-------root supergroup 0 2015-03-05 14:28/user/root/. TRASH/CURRENT/FLUME/EVENTSDRWX-------root supergroup 0 2015-03-05 14:28/user/root/. TRASH/CURRENT/FLUME/EVENTS/2015DRWX-------root supergroup 0 2015-03-05 14:28/user/root/. TRASH/CURRENT/FLUME/EVENTS/2015/01DRWX-------root supergroup 0 2015-03-05 14:28/user/root/. TRASH/CURRENT/FLUME/EVENTS/2015/01/28DRWX-------root supergroup 0 2015-03-05 14:28/user/root/. TRASH/CURRENT/FLUME/EVENTS/2015/01/28/15DRWX-------root supergroup 0 2015-03-05 14:31/user/root/. Trash/current/flume/events/2015/01/28/15/55[[email protected] bin]# SH HDFS Dfs-ls-r/flume/events/2015/01/28/15/55-rw-r--r--3 root supergroup 12207 2015-01-28 15:56/flume/events/2015/ 01/28/15/55/cmcc.1422431701282[[email protected] bin]#
"Hadoop 2.6" HDFs How to open Recycle Bin mechanism Trash, recover deleted files