[Gluster-infra] Postmortem for Thursday's outage

[Michael Scherer]

Le samedi 16 septembre 2017 à 18:42 +0530, Nigel Babu a écrit :
> Hello folks,
> 
> ## Pending Actions
> * Michael to figure out if there is a bug in the new DHCP daemon, or
> if
> things
>   changed Rackspace side.
> * Michael to finish move of salt-master into the cage
>   (ant-queen.int.rht.gluster.org) to prevent further issues.
> * Nigel to send a note to Rackspace support to fix their
> documentation.

So, just to give a update:
- salt-master got moved.
- the dhcp stuff seems to be related to cloud-init. I spent a few hours
trying to understand the issue, but it seems that cloud-init reset the
interface to use dhcp, and then fail. I suspect this was due to 7.4
upgrade. 

Others VM got hit (freeipa, for example), but I now found a quick way
to fix, by using the internal rackspace network.
-- 
Michael Scherer
Sysadmin, Community Infrastructure and Platform, OSAS

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 836 bytes
Desc: This is a digitally signed message part
URL: <http://lists.gluster.org/pipermail/gluster-infra/attachments/20171025/7ae4aa6a/attachment.sig>