So my day was quite eventful to say the least...I came in to work early only to find out that our app was down...the webservers were up, but people kept getting login errors.  So I checked a few places and realized there was a problem with the DB...a much bigger problem then I thought.  I did some checks but concluded that my best course of action was to bounce the box...so I did...only it never came back up...so I hauled ass to the datacenter (which is fortunately across our parking lot) and saw three of our 7 drives were marked failed by our storage array...SHIT!  I just added two more drives to the array on Friday night and nothing crashed until Sunday night some time.  I reseated the drives, marked them online and got the app back running, but it certainly wasn't in a stable state...just a state the would hopefully get us through the day.  So I got on the phone with Dell to see about getting new drives and they won't do a thing until I run certain integrity checks...which they wanted me to run a 9am this morning...not gonna happen.  Well here I am at 2am and I'm running the first of many processes..the consistancy check which will verify the parity of our RAID array...our 209GB RAID array....I've been at it for 15 or so minutes and I'm at a whopping 4%. 

On a positive note I've successfully fixed my DNS issue..not thanks to any slackers at work.  Sometimes I hate being the only one at a company that knows what I know...sometimes...  Much like I've had to rebrand Bugzilla as Stevezilla, I'll also have to rebrand cPanel as stevePanel because I had to change so much shit to get it all to work.  I've had to re-write the perl file that rebuilds the named.conf file for DNS zones so I dumped that into CVS for the next time I upgrade cPanel..I'm sure I'll have to replace that file...hopefully I remember that I have to replace that file...we'll see. 

We're heading to SC this weekend to visit my folks.  I haven't seen them since early this summer when we last went camping so it'll be fun to do that.  It's my youngest brother's birthday today so I'm sure we'll celebrate that this weekend as well.  I've already gone and emailed the president of the Charleston chapter of the PSU alumni association and got the location on their meeting venue for this weekend's game.  West Wings...sounds right up my alley!  It would be a completely football weekend, having a game Friday, Saturday and Sunday, but Michael apparently doesn't play anymore...He was second string on the Varsity team and because the team is just barely squeeking out wins he doesn't see any play time...plus his grades are in the shitter which didn't help matters.