![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
bjarvisOur disaster recovery exercise continues.
Since 1 PM, I've been in the Urbana, MD, data center, in my usual cube. As expected, the dual-side production architecture of my business group dealt with the "disaster" at the Reston data center seamlessly. At the appointed time, we flipped the switches and the network load balancers redirected all traffic appropriately.
Not all business groups within the corporation are so resilient, however. Some applications which are cared for by other teams of UNIX admins have experienced issues ranging from trivial to complete collapse. I get the vicarious thrill of listening to these problems and the quest for solutions by sitting in on conference calls, looking for opportunities to provide assistance. It's unfortunate some folks had such difficulties, but I guess this is ultimately why we do these annual exercises. I've been keeping myself busy by writing up further standards & policies which are due by the end of the year. Whee.
At 5 PM EST, we declared the "disaster" in Reston to be complete and are now restoring full dual-site functionality. Again, my business group did the fail-back within minutes and have spent the balance of the hour merely conducting tests to confirm all is well.
Did I mention the office is feeding us? I have a large plate of broccoli and chicken in my cube now, accompanied by an even larger plate of cookies, brownies and lemon squares, all washed down with Coke Classic. It ain't great food but the price is right.
I wish I was at various Halloween parties than at the office though.
Since 1 PM, I've been in the Urbana, MD, data center, in my usual cube. As expected, the dual-side production architecture of my business group dealt with the "disaster" at the Reston data center seamlessly. At the appointed time, we flipped the switches and the network load balancers redirected all traffic appropriately.
Not all business groups within the corporation are so resilient, however. Some applications which are cared for by other teams of UNIX admins have experienced issues ranging from trivial to complete collapse. I get the vicarious thrill of listening to these problems and the quest for solutions by sitting in on conference calls, looking for opportunities to provide assistance. It's unfortunate some folks had such difficulties, but I guess this is ultimately why we do these annual exercises. I've been keeping myself busy by writing up further standards & policies which are due by the end of the year. Whee.
At 5 PM EST, we declared the "disaster" in Reston to be complete and are now restoring full dual-site functionality. Again, my business group did the fail-back within minutes and have spent the balance of the hour merely conducting tests to confirm all is well.
Did I mention the office is feeding us? I have a large plate of broccoli and chicken in my cube now, accompanied by an even larger plate of cookies, brownies and lemon squares, all washed down with Coke Classic. It ain't great food but the price is right.
I wish I was at various Halloween parties than at the office though.
