in

SharePoint Blogs

The Best Place for SharePoint-related Blogs

The Dean's Office

I hate Murphy, but I love SharePoint Blogs users and bloggers!

How does it go again?  "The worst thing will happen at the worst possible time."  That's the most often-seen definition of Murphy's law, right?

Right.

So, imagine if you will.  You've been selected as a speaker at TechEd in Orlando, Florida.  You arrive on a Sunday, have a nice dinner and some drinks with friends you haven't seen in months (and may not see again until the next big conference), and unwind.  The hotel?  It's nice; it has its quirks, but it's Orlando and the hotel has lots of flowers around it and a nice fountain and ... you get the point.  That first day, the tension is already melting.  Good friends, good food, good drinks, good weather.  You go to bed the first night, ready and rarin' to start your week at Tech Ed with a bang.  The alarm is set for 7PM so you can shower and catch the keynote before hitting the expo floor for the morning's "swag tour".

Your phone, set to beep only if messages arrive from your spouse or from your server monitoring system, starts beeping before the sun even rises.

"Server down."

To quote Starbuck (and, well, pretty much every other lead character in Battlestar Galactica): "Frak me."

I don't know about you, but I hate waking up that way.  I prefer to wake up before the alarm goes off, slowly roll out of bed, and crawl into the shower.  I'm not a morning person at all.

I'll speed up the story now.  No sense reliving the whole tragedy.  Here's the fast-forward version: Server crashes, catastrophic RAID failure.  Backups, tested monthly (and last tested three weeks ago) are useless.  I rebuild the array and run some software that recovers files from their original stripes, and recover a surprising number of files.  They're all pretty mangled, and most of them are useless.  I don't really have the time or the focus to start new servers from scratch while I'm in Orlando.  Not that the servers were in my house or anything (they weren't, of course, we're not some fly-by-night operation here), but a hotel room with a slow network connection is not the best place to do your best technical work.

Thursday afternoon comes, and I'm dangerously close to a breakdown.  I've been knee-deep in server doo-doo for days.  Todd and Matt (two of the greatest trainers in the world, I should add) dive into the muck with me and both of them say (alternately), "Dude, take a break, we'll help you clean this up."  It's hard to let go, but I can see that I'm minutes away from a full-blown freak-out.  I quietly put down the laptop lid, put on some shorts and sandals, and drive to Epcot to ride Mission Space four times.  Then, off to the attendee party at Universal Studios Islands of Adventure.

Friday didn't seem as bad.  It got better, too, because my wife and son arrived to spend a long weekend with me in Florida.  We saw my mom and step-dad, went to a few tourist traps, and all-in-all had a great time.

When I get home, I have one full day before I need to leave again to teach a class.  SharePoint Experts and SharePoint Bootcamp come back online during that time.  Then, I spend my evenings and Father's Day weekend getting as much content back into SharePoint Blogs as possible (thanks again to Dan Larson and Glenn Barry from NewsGator for their help in recovering old content), and here we are.

I said that I hate Murphy, and I do: His laws suck out loud.  But YOU guys are another story; the readers and bloggers here at SharePoint Blogs are part of the the greatest technology community on this planet.  Every e-mail I've received has been supportive and appreciative.  Every phone call and blog comment cheers me on.  I can't thank you guys enough for your patience, your understanding, and your support!  It's been a bumpy road, and we still have some ways to go, but the outpouring of support I've received by e-mail has given me the energy to keep going. 

So, from the bottom of my heart, THANK YOU.

You guys rock.

Comments

 

twh said:

Can you fill us in on why the backups were useless?  This is a situation a lot of us would like to be able to avoid ;-)

June 20, 2007 10:39 AM
 

Dustin Miller said:

Unrelated corruption on the NAS device used for backups.  Two sets of backups would be the way to avoid this. Wink

June 20, 2007 11:07 AM
 

MossMan said:

We need to all pitch in and get Dustin something off of his amazon wishlist... assuming he has one.

June 20, 2007 1:58 PM
 

mossman's blog said:

Big thanks to Dustin Miller and his friends for getting SharePointBlogs back! I have known for a while

June 20, 2007 8:44 PM
 

Matt Taylor said:

I won't be returning Dustin. I still cannot believe that through the entire episode you didn't once take the time to email bloggers like myself who had no idea what was happening, why the site was down or if it would ever return.

Better luck keeping this valuable service running in the future but you lost my vote and my confidence with a lack of some pretty basic business skills.

June 22, 2007 3:54 AM
 

Chris said:

Wow, Matt I'm amazed you didn't hear the updates on this through other SharePoint blogs. Bob Fox, Andrew Connell, Joel Oleson and _many_ others wrote about this at Dustin's request. I think a great job was done on communication.

I don't know the details, but I'd guess sending mails to every single blogger on sharepointblogs would require a bit more than Outlook and a few addresses. If the hardware and data aren't available, surely this could be a bit tricky?

Considering we've heard all the right things were being done, I think you should cut some slack.

June 25, 2007 4:31 AM
 

Dustin Miller said:

Chris hit it on the nose.  With nearly 400 bloggers and zero database access, it's pretty impossible to do that.  I did what I could through my friends in the community.

I'll leave your blog online for a while, Matt.  If you decide that you want to "claim" it and start posting again, just use the Contact link on my blog and let me know.

June 25, 2007 7:12 PM
 

Dustin Miller said:

Incidentally, I believe I answered every e-mail that came in to my SPE account regarding the blogs site going down.

I guess I could give you your money back? Wink

June 25, 2007 7:14 PM
 

Mark said:

Well Matt, I've never read your blog and now will make a point of never doing so in the future. Maybe someday you will have a major problem you will have to deal with and will learn some humility and preferably, being English, some manners too.

July 13, 2007 11:35 AM
 

Matt Taylor said:

Oh dear Mark. As much as I feel that Dustin's comments missed my point I can at least respect his point of view. I cannot extend that to the comments of an <snipped by editor for hateful language>.

July 18, 2007 4:32 AM
 

Dustin Miller said:

Now that's enough.  

Matt: If you disagreed with my response (which did address any points made that the original post or earlier comments didn't), you had ample opportunity to reply.  Your attack on the previous commenter was uncalled for (read Mark's response carefully, it included no such personal assault), and you are no longer welcome here (nor is your blog).  Not because you disagreed with me or anyone else, but because you resorted to a character assault as a way to "get back" at someone.  You should be ashamed.

(note: I edited Matt's comment to remove the troll bait, and locked this thread to further comments.)

July 18, 2007 8:40 AM

Need SharePoint Training? Attend a SharePoint Bootcamp!

Posts (c) their respective authors. Everything else (c) 2007 SharePoint Experts