SnV Forums

[beyonder]

As you may have noticed, there was some unexpected downtime last night. This problem has been fixed for now, and some steps have been taken to prevent it from happening again in the future. Something ran away with a large chunk of the server's memory. This caused PHP to not be able to start properly, however files that did not require PHP were still being served properly(since that doesn't need nearly as much memory).

While I was not able to figure out what process had stolen all my memory, a simple reboot got everything working again. In order to prevent this from happening again I have written a shell script which does the following:

E-mails me the output of `ps axu`
If memory usage is above 90%, sends a text message to my cell phone

This shell script is set to run every 5 minutes via cron, so should this happen again I will be able to a.) track it down to what process ate the memory b.) respond a lot faster.
_________________

[anngry]

i think it goes without saying dude, but youre a really good admin.
_________________


and the cheat will hit stuff with a golf club! SEE-GEE-IN-YOU.

[cow_with_gun]

Hot tech talk.

Cellphones? What kind of newfangled device is that?

Text message? I thought they were only in my dreams.