SnV Forums Forum Index SnV Forums

 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Downtime

 
Post new topic   Reply to topic    SnV Forums Forum Index -> Announcements
View previous topic :: View next topic  
Author Message
beyonder
^.^


Gender: Gender:Male
Joined: 12 Mar 2006
Posts: 321
Status: Administrator

PostPosted: Tue Jan 16, 2007 11:13 am    Post subject: Downtime Reply with quote

As you may have noticed, there was some unexpected downtime last night. This problem has been fixed for now, and some steps have been taken to prevent it from happening again in the future. Something ran away with a large chunk of the server's memory. This caused PHP to not be able to start properly, however files that did not require PHP were still being served properly(since that doesn't need nearly as much memory).

While I was not able to figure out what process had stolen all my memory, a simple reboot got everything working again. In order to prevent this from happening again I have written a shell script which does the following:

E-mails me the output of `ps axu`
If memory usage is above 90%, sends a text message to my cell phone

This shell script is set to run every 5 minutes via cron, so should this happen again I will be able to a.) track it down to what process ate the memory b.) respond a lot faster.
_________________
Back to top
View user's profile Send private message Visit poster's website AIM Address
anngry
crunk warrior


Gender: Gender:Female
Joined: 13 Mar 2006
Posts: 586
Status: User
Location: New Finland

PostPosted: Tue Jan 16, 2007 6:20 pm    Post subject: Reply with quote

i think it goes without saying dude, but youre a really good admin.
_________________


and the cheat will hit stuff with a golf club! SEE-GEE-IN-YOU.
Back to top
View user's profile Send private message Visit poster's website AIM Address
cow_with_gun



Gender: Gender:Male
Joined: 28 Sep 2006
Posts: 1530
Status: User
Location: New-Fine-Land

PostPosted: Tue Jan 16, 2007 8:02 pm    Post subject: Reply with quote

Hot tech talk.

Cellphones? What kind of newfangled device is that?

Text message? I thought they were only in my dreams.
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   Reply to topic    SnV Forums Forum Index -> Announcements All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2005 phpBB Group