[OT] Generator testing

[Ben Scott]

On Wed, Sep 9, 2009 at 2:29 PM, Jerry Feldman <gaf at blu.org> wrote:
> I worked at a facility that did not have a backup generator but did have
> 2 separate power lines from 2 different power companies. Of course that
> does not help when the grid fails.

  There's usually a single-point-of-failure.

  Within the past 18 months or so, a big datacenter went out because a
transformer in their power vault exploded.  It knocked down the wall
with all the electrical panels on it, sheering off all the conduits
and wires.  I saw a picture of their parking lot a week later; there
must have 20 generator trucks parked outside, and enough cable to
reach half-way to the moon.

  Another scenario I saw put forth on NANOG: "Can your disaster
recovery plan cope with a fire marshal pointing at your data center
and saying, 'Turn that off.  *Right now*.'?"  (Fire fighters are real
touchy about energized equipment.  (Understandably.))

  But it's funny, lots of people have disaster stories... it seems
everyone knows what *not* to do, or what can go wrong... but if you
ask what you *should* do, and people are less certain.  :)

-- Ben