beginning of the line, only the string that is matched to the pattern for the first time in each row is replacedAdd modifierg: Global substitution , just find replacementExample sed ' s/\//#/g '/etc/fstab global replacementI: Ignore case when findingThe grep latter reference is enclosed in front, followed by a \1, \2,\ number to refer toCreate file Test.txt, write contentHello,likeHi,my LoveSed ' s#l. E#l.
Very powerful text manipulation tool, Sed,awk,grep This three command is the operation of the text fileThe UNIX system has several very special features:1. For the kernel, UNIX files are byte sequences. IO devices are also files.2. The meaning of the document is referred to the application for interpretation. The text files are very important because UNIX provide
: delete command"$1": Refers to a command line parameter, indicating that white space or special characters can be used in the file name.
2. replace a string (or matching mode) in a file with another string (or matching mode)Sed-e "s/$ old_pattern/$ new_pattern/g" $ file_nameS: substitution replacement"G", that is, the global flag, used to automatically replace
3. Write log filesEcho "'date' + 'whoam' + $ operation" $ @ ""> $ file_name$ Operation: bef
Combat one: File a006 take out the numbers insideTl_fmt_chg_shm_key=7100;export Tl_fmt_chg_shm_keyTl_msq_shm_key=7200;export Tl_msq_shm_keyTl_txn_srv_shm_key=7300;export Tl_txn_srv_shm_keySed methodSed ' s/\ (. *\) =\ (. *\); \ (. *\)/\2/' a006710072007300awk-f\; ' {print $} ' a006 | Awk-f= ' {print $} '//awk methods There are a lot of things I only use in one simple way710072007300Combat two: List command
Awk is a programming language dedicated for text processing. yes, it is a programming language. It only serves text processing, so you cannot use it to write system software or scientific computing (of course, it can also do mathematical computing ), it can only be used for text processing. unlike SED, awk has the programming language features, including built-in
/etc/profile/etc/bashrc, variables are added to the shell environment and are permanently active./root/.bashrc/root/.bash_profileRegular expressionsDefinition: a regular is a way to describe a character or string by combining symbols with special meanings, called regular expressions. (explained by the Order)Three types of text processing tools/commands: grep sed awkgrep (filter)Parameters-n: Show Line numbe
of LA, if you want to complete the replacement, you should add the global command G, as follows: SED-N'S/LA/OO/GP'DATAF3 This will change all the found LA to OO. The use of substitution, there are also the following: Sed-N's/la//p'DATAF3 Deletes the first occurrence of LA in each row (the substitution of La into an empty string is deleted). Sed's/^...//'DATAF3 Remove the 3 characters from the beginning of
#!/bin/env python#coding: UTF8‘‘‘awk prints the specified number of rowsSED prints the specified number of linesPython prints the specified position, a length stringAwk takes the longest, a long timeSed awk time HalfPython time-consuming basic negligibleWhen you use a script to monitor log files, the location of the last exit is loggedPython is the most efficient.‘‘‘Import OSFrom time Import timeFrom Os.pat
Recently, the linux commands grep, awk, cut, uniq, wc are used to calculate the number of players who use commands every day. comgzip-c-dnohup.out. 'date + % Y % m % d '*. gz | grep/web/api/logic/logicDispatcher | awk amp; #39; {FS quot; amp
Recently learned linux commands grep
does not end with 90,/90 $ /! Enter {n; B myloop }. N enters the multi-row mode, attaches the next row, and then enters branch B myloop. It judges whether it ends with 90 and reads it repeatedly until it reads the row ending with 90. Next, the read of the mode space is complete. Enter the next command, replace, S/\ N // G? This command converts all linefeeds in the current mode space to null, that is, concatenates them into a row. In this way, we have achieved our goal.
2.
Here are just the simplest ways to do this.SED implementationOne:Odd line sed-n ' p;n ' fileEven line sed-n ' n;p ' fileThis may be difficult to understand, as an example on the Internet:example, remove even rows from the AAA fileCat AAAThis is 1This is 2This is 3This is 4This is 5Sed-n ' n;p ' AAA//-n means cancel default outputThis is 2This is 4Note: Sed reads
Sed amp; Awk uses the p command to output the current patternspace ). In the 1st line of the file, the output of each line is two times: sedamp;%39%pamp;%39%employee.txt 101, JohnDoe, CEO101, JohnDoe, CEO102, JasonSmith, ITManager Sed Awk.
The p command can be used to output the current pattern space ). 1. Output $
Use of grep and sed in Linux
Common commands in Linux.
1. grep command
Grep is used to filter the content you need. The syntax is as follows:
Grep Mayuyu -- color
Filter out all rows containing Mayuyu. The grep also supports regul
possible on each line. If there is no G character, then the SED command will only substituteHappy the first occurrence of a word in a row.The SED command operates as a filter. It is from a standard input or a file named in the command line (in this caseCHAP1) reads text, modifies text, and writes it to standard output. Unlike most editors, it does not replace the original file. In the waterLine is used, th
grep [option] Pattern [FILE ...]-I: Ignore case--colour: Display in a highlighted color-V: Show rows that are not matched to-O: Displays only the string that is matched to-E: Using extended regular expressions-A #: including how many lines later-B #: including how many lines ahead-C #: including how many lines before and afterTo extend the regular expression:Character Matching:.[] such as: a-z,a-z[^]Number of matches:*: Any time before the character?
Command usage: Displays the contents of 20 to 30 lines of the file-------------------------------------------------SeqGenerating sequencesSEQ >[file name] Generates a sequence of 1~100 rows:123...100Note:The sequence starts at 1 only when the maximum value is defined aboveSEQ 0 100 starts from 0, sequence order follows natural number orderSeq-1 100 starting from-1:-1 0 1 ... 100-------------------------------------------------SedStream Editor Stream editorsSed-n ' 20,30p ' [file name] prints 20
another string with one string. The format is "line range s/old string/new string/g"Sed can receive the output of a pipe characterExample:Sed ' 2p ' a.txt #输出第2行后 and output all the content againSed-n ' 2p ' a.txt #只输出第二行Sed ' 2,4d ' a.txt #删除第2到4行, only removes screen output and does not change the contents of the file itselfSed ' 2a hello ' a.txt #在第二行插入一行 helloSed ' 2i hello ' \word ' a.txt #在第二行前插入多行 h
Sed shares the common functions sed and awk. However, we can understand that sed performs operations on text content (Text replacement) and awk performs operations on text structure. 1. Replace zhc in the filename file with hongchangfirst and put it in filename2. Sed's/zhc/h
#!/bin/env python#coding: UTF8‘‘‘awk prints the specified number of rowsSED prints the specified number of linesPython prints the specified position, a length stringAwk takes the longest, a long timeSed awk time HalfPython time-consuming basic negligibleWhen you use a script to monitor log files, the location of the last exit is loggedPython is the most efficient.‘‘‘Import OSFrom time Import timeFrom Os.pat
Use GoAccess to analyze Nginx logs and sed/awk manual analysis practices, goaccessng.pdf
Preface
Websites using Nginx may encounter access traffic exceptions, friendship detection, program bugs, and other sudden situations. At this time, everyone's response must be the first time to analyze logs, then I found that there are dozens of gigabytes of logs, and whether the information needs to be searched by ti
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.