by Rich Rousseau
9. June 2006 22:25
So when I arrived at work this morning I noticed that my computer had
been restarted. After a quick brain scan I reassured myself that I had
saved all my work from the last night. I logged in and checked my
computer's even log. System came back up at 6:30, but no activity from
about 11pm till then. I decide to check on the servers...
Domain Controllers (check, check)
Database (check)
Citrix (check)
Web Server...
Our web server wasn't responding. No biggie, I grab my keys and walk
down to the server room to cycle it. As I approached the server room I
noticed an unusually loud fan noise. I unlock the room and step into a
sauna. By now I'm wondering what servers have been fried. I check the
AC controls (our server room has it's own AC unit on the roof) and they
read 99 degrees. I turn them off then back on. Nothing. Ok, time to
call the boss. After getting the office park's phone number from the
boss I give them a call. Apparently ComEd blew something and the entire
office park (5 buildings) was in the dark from midnight to around 6:30.
They are currently going building to building checking the breakers to
make sure everything is back up. About 10 minutes after that
conversation the head engineer stops by the office. I've met this guy
before when all of the personal heaters we run in our office were
causing circuits to trip. He told me that he'd have someone reset our
AC unit on the roof and that should cool things off.
As of right now we still do not have AC in the server room. I borrowed
a fan from another employee's office and I'm blowing cool air into the
room. It's lowered the temp from about 99 to 94.
An interesting start to a Friday.
Edit - Apparently when I email a blog post it doesn't preserve the formatting.