Website accidents caused by insufficient space

 

Case 1:

Brief Description:

Production Server/HomeDirectory disk space100%,Decompression exception,In this case, the website channel cannot be accessed..

Service Environment Description:

Local Publishing Server Data transfer in Prerelease Server Production Server

Release Process Description:

Compile and package on the local Publishing Server-->Transfer to data-->Pull data packets to the prerelease Server-->Pre-release test passed-->Publish to production server

Scenario playback:

After the pre-release test is passed,After the service is published by publishing scripts, F5Alarm,No alert is reported for the Application Service.,The homepage of the channel cannot be opened..

Homepage of the production serverIndex.htmlBlank, MonitorFile Blank.

Cause Analysis:

Production Server/HomeDirectory Space100%, tarDecompression failed,Script Execution continues(Bug ),EmptyINDEx.htmlAndMonitorFile.CauseF5AutomaticDisableService,In this case, some functions of the website cannot be accessed..

Remedy:

WebServer/HomeDirectory and disk capacity monitoring(WholeDiskMonitored,The uploaded data is saved to the storage device.)

Fix release scriptsBug

 

Case 2:

Brief Description:

Disk Space of the local Publishing Server100%An error occurs on the homepage of the channel..

Script Summary:

RM/home/UED/deploy/*-Rf

mkdir-P/home/UED/htdocs_convert/htdocs

rsync-ac -- delete/home/UED/htdocs/home/UED/htdocs_convert/

RM-RF/home/UED/htdocs_convert/htdocs/old

Find/home/UED/htdocs_convert/htdocs-name "*. *" | egrep-I ". S? HTML? $ |. Inc $ |. js $ |. CSS $ "| xargs sed-I" s # http: // static.

domain.com/\ ([-. _ a-zA-Z0-9/] * \) \ ([0-4a-na-n] \. \) \ (jpe \? G \ | GIF \ | PNG \ | SWF \) # http://static1.domain.com/?datestamp/%1%2%3%g%s%http://s

tatic.domain.com/\ ([-. _ a-zA-Z0-9/] * \) \ ([5-9o-zo-z] \. \) \ (jpe \? G \ | GIF \ | PNG \ | SWF \) # http://static2.domain.com/?datestamp/%1%2%3%g%s%ht

TP: // static.domain.com # http://static.domain.com/?datestamp=g; "

Cd/home/UED/htdocs_convert; tar-cvzf/home/UED/deploy/$ deploy_file_name htdocs/

. / rsync_deploy . sh ( subsequent release )

Exception:

After the static page is published successfully,Channel homepage style loss.

AppearsHttp://static.domain.com/1341341243/134413244134/CSS/style.css OfAddress

The normal address isHttp://static.domain.com/1341341243/CSS/style.css

Disk Space of the local Publishing Server100%

Cause Analysis:

The generated Address indicates that the script has been executed twice to replace some files..

/Home/UED/htdocs_convert/(Directory andSVNConsistent)

Rsync-ac -- delete It should be ensured that files in/home/UED/htdocs will not be replaced twice...

But it does run twice.,Strange.What causes this problem??

Other information:

/Home/UED/htdocs_convert/(250 m)

/Home/UED/htdocs_convert/htdocs/old(50 m)

After compression(40 m)

Analysis result:

1.Less Space40 mAfter,Replaced,Compression failed,Publishing failed At this time, the space already exists.100%

2. run the second release script , rsync failed, causing the file not to be synchronized after the first replacement , continue the delete operation ( RM-Rf /home/UED/htdocs_convert/htdocs/old ), released 50 m space

3.Perform the Replacement Operation(Note that this parameter is replaced twice.),Then Compress50 mEnough space for compression,Compressed,Released successfully(CSSThe link is replaced twice....)

4.Cup Creation.