<div><div>Hi Atin,</div></div><div><br></div><div>I assume you are referring to the /var/log/glustershd.log. If so, that file never gets created.</div><div><br></div><div>Joe </div><div><br><div class="gmail_quote"><div>On Wed, Jan 25, 2017 at 6:14 AM Atin Mukherjee <<a href="mailto:amukherj@redhat.com">amukherj@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="gmail_msg"><div class="gmail_extra gmail_msg"><div class="gmail_quote gmail_msg">On Wed, Jan 25, 2017 at 5:15 PM, Joseph Lorenzini <span class="gmail_msg"><<a href="mailto:jaloren@gmail.com" class="gmail_msg" target="_blank">jaloren@gmail.com</a>></span> wrote:<br class="gmail_msg"><blockquote class="gmail_quote gmail_msg" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="gmail_msg">Hi all,<div class="gmail_msg"><br class="gmail_msg"></div><div class="gmail_msg">I have recently started exploring the DFS solution space and was doing some basic setup and testing with gluster. I set up a pool of three nodes following the quick start guide. That seemed to work fine. </div><div class="gmail_msg"><br class="gmail_msg"></div><div class="gmail_msg">However, shortly after that, I noticed that one of the servers in the pool was becoming non-responsive -- as in the entire VM was completely hung and i had to use the hypervisor to force a reboot. I sshed into the server and startd poking around. glusterd was shut off. I started it up ....and the following happened:</div><div class="gmail_msg"><div class="gmail_msg"><br class="gmail_msg"></div></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px" class="gmail_msg"><div class="gmail_msg"><div class="gmail_msg"><div class="gmail_msg">Message from syslogd at Jan 25 05:20:47 ...</div></div></div><div class="gmail_msg"><div class="gmail_msg"> kernel:[ 288.145027] NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [glusterd:2374]</div></div></blockquote></div></blockquote><div class="gmail_msg"><br class="gmail_msg"></div></div></div></div><div class="gmail_msg"><div class="gmail_extra gmail_msg"><div class="gmail_quote gmail_msg"><div class="gmail_msg">Could you attach the glusterd log file to enable us to look at why glusterd got shutdown?</div><div class="gmail_msg"> </div><blockquote class="gmail_quote gmail_msg" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"></blockquote></div></div></div><div class="gmail_msg"><div class="gmail_extra gmail_msg"><div class="gmail_quote gmail_msg"><blockquote class="gmail_quote gmail_msg" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="gmail_msg"><div class="gmail_msg"><div class="gmail_msg"><br class="gmail_msg"></div><div class="gmail_msg">At which point, the VM became completely unresponsive again.</div><div class="gmail_msg"><br class="gmail_msg"></div><div class="gmail_msg">All servers are the same. They are running centos 7.3, linux kernel 3.10.0-514.2.2.el7.x86_64. The glusterfs-server is 3.8. </div></div><div class="gmail_msg"><br class="gmail_msg"></div><div class="gmail_msg">Since I just started investigating gluster, it is certainly possible that I misconfigured something on that one node. However, a kernel hang/panic seems like an excessive response :). If anyone would have any ideas or suggestions about what may be happening here or additional places I should look into to find out what is going on, I am all ears.</div><div class="gmail_msg"><br class="gmail_msg"></div><div class="gmail_msg">Thanks,</div><div class="gmail_msg">Joe</div></div>
<br class="gmail_msg"></blockquote></div></div></div><div class="gmail_msg"><div class="gmail_extra gmail_msg"><div class="gmail_quote gmail_msg"><blockquote class="gmail_quote gmail_msg" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">_______________________________________________<br class="gmail_msg">
Gluster-users mailing list<br class="gmail_msg">
<a href="mailto:Gluster-users@gluster.org" class="gmail_msg" target="_blank">Gluster-users@gluster.org</a><br class="gmail_msg">
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" class="gmail_msg" target="_blank">http://lists.gluster.org/mailman/listinfo/gluster-users</a><br class="gmail_msg"></blockquote></div></div></div><div class="gmail_msg"><div class="gmail_extra gmail_msg"><br class="gmail_msg"><br clear="all" class="gmail_msg"><div class="gmail_msg"><br class="gmail_msg"></div>-- <br class="gmail_msg"><div class="m_8728006750416976718gmail_signature gmail_msg" data-smartmail="gmail_signature"><div class="gmail_msg"><div class="gmail_msg"><div class="gmail_msg"><br class="gmail_msg"></div><div class="gmail_msg">~ Atin (atinm)<br class="gmail_msg"></div></div></div></div>
</div></div></blockquote></div></div>