Linux Tips: several methods to make processes run reliably in the background

We often encounter this problem. We use telnet/ssh to log on to a remote Linux server and run some time-consuming tasks. as a result, the task fails midway through due to network instability. How can I prevent the local terminal window/network disconnection after the command is submitted?... information &

We often encounter this problem. We use telnet/ssh to log on to a remote Linux server and run some time-consuming tasks. as a result, the task fails midway through due to network instability. After the command is submitted, how does one prevent the local terminal window/network disconnection? Here are some examples. you can select different methods for different scenarios to solve this problem.
Nohup/setsid /&
Scenario:
If a temporary command needs to be run for a long time, what method can be used to ensure its stable operation in the background?
Reason for hangup name
In earlier versions of Unix, each terminal communicates with the system through modem. When a user logs out, the modem hangs up. Similarly, when the modem is disconnected, it will send an hangup signal to the terminal to notify it to close all sub-processes.
Solution:
We know that when a user logs out or the network is disconnected, the supervisor will receive an HUP signal to close all its sub-processes. Therefore, our solution has two ways: either let the process ignore the HUP signal, or let the process run in a new session to become a child process that does not belong to this terminal.
1. nohup
Nohup is undoubtedly the first method we have come up. As the name suggests, nohup is used to make the submitted command ignore the hangup signal. Let's take a look at the Help information of nohup:
NOHUP (1) User Commands NOHUP (1) NAME nohup-run a command immune to hangups, with output to a non-tty SYNOPSIS nohup COMMAND [ARG]... nohup option description Run COMMAND, ignoring hangup signals. -- help display this help and exit -- version output version information and exit

It can be seen that nohup is very convenient to use. you only need to add nohup before the command to be processed. The standard output and standard error will be redirected to the nohup. out file by default. Generally, you can add "&" at the end to run the command in the background, or use "> filename 2> & 1" to change the default redirection file name.

Nohup example
[Root @ pvcent107 ~] # Nohup ping www.ibm.com & [1] 3059 nohup: appending output to 'nohup. out' [root @ pvcent107 ~] # Ps-ef | grep 3059 root 3059 984 0 00:00:00 pts/3 00:00:00 ping www.ibm.com root 3067 984 0 pts/3 grep 3059 [root @ pvcent107 ~] #

2. Setsid
Nohup can undoubtedly avoid interruption of our process by ignoring the HUP signal. However, if we think from another perspective that our process is not a sub-process of the terminal that accepts the HUP signal, then it will naturally not be affected by the HUP signal. Setsid can help us do this. Let's take a look at the Help information of setsid:
SETSID (8) Linux Programmer's Manual SETSID (8) NAME setsid-run a program in a new session SYNOPSIS setsid program [arg...] DESCRIPTION setsid runs a program in a new session.

It can be seen that the use of setsid is also very convenient, you only need to add setsid before the command to be processed.

Setsid example
[Root @ pvcent107 ~] # Setsid ping www.ibm.com [root @ pvcent107 ~] # Ps-ef | grep www.ibm.com root 31094 1 0? 00:00:00 ping www.ibm.com root 31102 29217 0 00:00:00 pts/4 grep www.ibm.com [root @ pvcent107 ~] #

In the preceding example, the process ID (PID) is 31094, and its parent ID (PPID) is 1 (that is, the init process ID ), it is not the process ID of the current terminal. Compare this example with the parent ID in the nohup example.
3. &
Here is also a tip about subshell. We know that the inclusion of one or more names in "()" allows these commands to run in the sub-shell, thus extending many interesting functions, we will discuss one of them now.
When we put "&" into "()", we will find that the submitted jobs are not in the job list, that is, they cannot be viewed through jobs. Let's take a look at why we can escape the influence of the HUP signal.

Subshell example
[Root @ pvcent107 ~] # (Ping www.ibm.com &) [root @ pvcent107 ~] # Ps-ef | grep www.ibm.com root 16270 1 0 00:00:00 pts/4 00:00:00 ping www.ibm.com root 16278 15362 0 pts/4 grep www.ibm.com [root @ pvcent107 ~] #

From the above example, we can see that the parent ID (PPID) of the newly submitted process is 1 (PID of the init process) and is not the process ID of the current terminal. Therefore, it does not belong to the sub-process of the current terminal, so it will not be affected by the HUP signal of the current terminal.

Disown
Scenario:
We already know that adding nohup or setsid before the command can avoid the influence of the HUP signal. But if we have submitted the command without any processing, how can we remedy it to avoid the impact of the HUP signal?
Solution:
It is too late to add nohup or setsid. you can only solve this problem through job scheduling and disown. Let's take a look at the Help information of disown:
Disown [-ar] [-h] [jobspec...] without options, each jobspec is removed from the table of active jobs. if the-h option is given, each jobspec is not removed from the table, but is marked so that SIGHUP is not sent to the job if the shell has es a SIGHUP. if no jobspec is present, and neither the-a nor the-r option is supplied, the current job is used. if no jobspec is supplied, the-a option means to remove or mark all jobs; the-r option without a jobspec argument restricts operation to running jobs. the return value is 0 unless a jobspec does not specify a valid job.

We can see that we can achieve our goal in the following ways.
Flexible use of CTRL-z
In our daily work, we can use CTRL-z to suspend the current process to the background and execute some other operations, then, use fg to re-run the suspended process back to the foreground (you can also use bg to put the suspended process in the background) to continue running. In this way, you can flexibly switch between multiple tasks in one terminal, which is particularly useful in code debugging. Because when the code editor is suspended to the background and then placed back, the cursor position remains at the position of the last suspension, avoiding the trouble of locating again.
Use disown-h jobspec to make a job ignore the HUP signal.
Use disown-ah to make all jobs ignore the HUP signal.
Use disown-rh to ignore the HUP signal for running jobs.
It should be noted that after disown is used, the target job will be removed from the job list, and we will no longer be able to use jobs to view it, however, you can still find it using ps-ef.
However, there is another problem: the operation object of this method is a job. if we add "&" at the end of the command to make it a job and run it in the background, everything is fine. we can use the jobs command to get a list of all jobs. But if the current command is not run as a job, how can I get its job number? The answer is to press CTRL-z (hold down the Ctrl key while holding down the z key!
CTRL-z is used to Suspend the current process (Suspend), then we can use the jobs command to query its job number, and then use bg jobspec to put it in the background and continue running. Please use this method with caution if suspension affects the running result of the current process.

Disown Example 1 (if the command has been run in the background with "&", you can directly use "disown ")
[Root @ pvcent107 build] # cp-r testLargeFile largeFile & [1] 4825 [root @ pvcent107 build] # jobs [1] + Running cp-I-r testLargeFile largeFile & [root @ pvcent107 build] # disown-h % 1 [root @ pvcent107 build] # ps-ef | grep largeFile root 4825 968 1 00:00:00 pts/4 cp-I-r testLargeFile largeFile root 4853 968 0 00:00:00 pts/4 grep largeFile [root @ pvcent107 build] # logout

Disown Example 2 (if you do not use "&" to run the command in the background when submitting the command, you can use CTRL-z and "bg" to put it in the background, and then use "disown ")
[Root @ pvcent107 build] # cp-r testLargeFile largeFile2 [1] + Stopped cp-I-r testLargeFile largeFile2 [root @ pvcent107 build] # bg % 1 [1] + cp- i-r testLargeFile largeFile2 & [root @ pvcent107 build] # jobs [1] + Running cp-I-r testLargeFile largeFile2 & [root @ pvcent107 build] # disown-h % 1 [root @ pvcent107 build] # ps-ef | grep largeFile2 root 5790 5577 1 00:00:00 pts/3 00:00:00 cp-I-r testLargeFile largeFile2 root 5824 5577 0 pts/3 grep largeFile2 [root @ pvcent107 build] #

Screen
Scenario:
We already know how to protect the process from the HUP signal. but if a large number of such commands need to be run in a stable background, how can we avoid such operations on each command?
Solution:
The most convenient method is screen. Simply put, screen provides an ANSI/VT100 terminal simulator to run multiple full-screen pseudo terminals under a real terminal. Screen has many parameters and has powerful functions. here we will only introduce its common functions and briefly analyze why screen can avoid the impact of HUP signals. Let's take a look at the Help information of screen:
SCREEN (1) SCREEN (1) NAME screen-screen manager with VT100/ANSI terminal emulation SYNOPSIS screen [-options] [cmd [args] screen-r [[pid.] tty [. host] screen-r sessionowner/[[pid.] tty [. host] DESCRIPTION Screen is a full-screen window manager that multiplexes a physical terminal between several processes (typically interactive shells ). each virtual terminal provides the functions of a DEC VT100 terminal and, in addition, several control functions from the ISO 6429 (ECMA 48, ANSI X3.64) and ISO 2022 standards (e.g. insert/delete line and support for multiple character sets ). there is a scrollback history buffer for each virtual terminal and a copy-and-paste mechanic that allows moving text regions between windows.

Screen is easy to use and has the following common options:
Use screen-dmS session name to create a session in Disconnected mode (and specify its session name ).
Use screen-list to list all sessions.
Use screen-r session name to reconnect to the specified session.
Press CTRL-a d to temporarily disconnect the current session.

Screen example
[Root @ pvcent107 ~] # Screen-dmS Urumchi [root @ pvcent107 ~] # Screen-list There is a screen on: 12842. Urumchi (Detached) 1 Socket in/tmp/screens/S-root. [root @ pvcent107 ~] # Screen-r Urumchi

When we use "-r" to connect to the screen session, we can do whatever we want in this pseudo terminal, and no longer have to worry about the impact of the HUP signal on our processes, you do not need to add "nohup" or "setsid" to each command. Why? Let me take a look at the two examples below.

1. process tree of the new process when screen is not used
[Root @ pvcent107 ~] # Ping www.google.com & [1] 9499 [root @ pvcent107 ~] # Pstree-H 9499 init-procedure-Xvnc restart-acpid restart-atd restart-2 * [sendmail] restart-sshd-procedure-sshd ── bash ── pstree │ restart-sshd ── bash ── ping

We can see that when screen is not used, bash is a sub-process of sshd. when ssh is disconnected, the HUP signal will naturally affect all sub-processes (including the newly created ping process) under it ).

2. process tree of the new process after screen is used
[Root @ pvcent107 ~] # Screen-r Urumchi [root @ pvcent107 ~] # Ping www.ibm.com & [1] 9488 [root @ pvcent107 ~] # Pstree-H 9488 init-restart-Xvnc restart-acpid restart-atd restart-screen ── bash ── ping restart-2 * [sendmail]

When screen is used, bash is the sub-process of screen, while screen is the sub-process of init (PID is 1. When ssh is disconnected, the HUP signal will not affect the sub-processes under the screen.

Summary
Now several methods have been introduced. we can select different solutions based on different scenarios. Nohup/setsid is undoubtedly the most convenient method for temporary needs. disown can help us to remedy jobs that are already running afterwards, screen is the best choice for batch operations.


Author: gflei