<div dir="ltr"><div>Let me know if you still see problems.</div><div><br></div><div>Thanks,</div><div>Nithya</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, 14 Feb 2019 at 09:05, Patrick Nixon <<a href="mailto:pnixon@gmail.com">pnixon@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">Thanks for the follow up. After reviewing the logs Vijay mentioned, nothing useful was found.<div dir="auto"><br></div><div dir="auto">I wiped removed and wiped the brick tonight. I'm in the process of balancing the new brick and will resync the files onto the full gluster volume when that completes </div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Feb 13, 2019, 10:28 PM Nithya Balachandran <<a href="mailto:nbalacha@redhat.com" target="_blank">nbalacha@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, 12 Feb 2019 at 08:30, Patrick Nixon <<a href="mailto:pnixon@gmail.com" rel="noreferrer" target="_blank">pnixon@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">The files are being written to via the glusterfs mount (and read on the same client and a different client). I try not to do anything on the nodes directly because I understand that can cause weirdness. As far as I can tell, there haven't been any network disconnections, but I'll review the client log to see if there any indication. I don't recall any issues last time I was in there.<br><br></div></blockquote><div><br></div><div>If I understand correctly, the files are written to the volume from the client , but when the same client tries to list them again, those entries are not listed. Is that right?</div><div><br></div><div>Do the files exist on the bricks?</div><div>Would you be willing to provide a tcpdump of the client when doing this? If yes, please do the following:</div><div><br></div><div>On the client system:</div><div><ul><li>tcpdump -i any -s 0 -w /var/tmp/dirls.pcap tcp and not port 22<br></li><li>Copy the files to the volume using the client<br></li><li>List the contents of the directory in which the files should exist<br></li><li>Stop the tcpdump capture and send it to us.<br></li></ul></div><div><br></div><div>Also provide the name of the directory and the missing files.</div><div><br></div><div>Regards,</div><div>NIthya</div><div><br></div><div><br></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Thanks for the response!</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Feb 11, 2019 at 7:35 PM Vijay Bellur <<a href="mailto:vbellur@redhat.com" rel="noreferrer" target="_blank">vbellur@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sun, Feb 10, 2019 at 5:20 PM Patrick Nixon <<a href="mailto:pnixon@gmail.com" rel="noreferrer" target="_blank">pnixon@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr">Hello!<div><br></div><div>I have an 8 node distribute volume setup. I have one node that accept files and stores them on disk, but when doing an ls, none of the files on that specific node are being returned.<br><br> Can someone give some guidance on what should be the best place to start troubleshooting this?<br></div></div></div></div></blockquote><div><br></div><div><br></div><div>Are the files being written from a glusterfs mount? If so, it might be worth checking if the network connectivity is fine between the client (that does ls) and the server/brick that contains these files. You could look up the client log file to check if there are any messages related to rpc disconnections.</div><div><br></div><div>Regards,</div><div>Vijay</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div><br><div># gluster volume info</div><div><br></div><div>Volume Name: gfs</div><div>Type: Distribute</div><div>Volume ID: 44c8c4f1-2dfb-4c03-9bca-d1ae4f314a78</div><div>Status: Started</div><div>Snapshot Count: 0</div><div>Number of Bricks: 8</div><div>Transport-type: tcp</div><div>Bricks:</div><div>Brick1: gfs01:/data/brick1/gv0</div><div>Brick2: gfs02:/data/brick1/gv0</div><div>Brick3: gfs03:/data/brick1/gv0</div><div>Brick4: gfs05:/data/brick1/gv0</div><div>Brick5: gfs06:/data/brick1/gv0</div><div>Brick6: gfs07:/data/brick1/gv0</div><div>Brick7: gfs08:/data/brick1/gv0</div><div>Brick8: gfs04:/data/brick1/gv0</div><div>Options Reconfigured:</div><div>cluster.min-free-disk: 10%</div><div>nfs.disable: on</div><div>performance.readdir-ahead: on</div><div><br></div></div><div><div># gluster peer status</div><div>Number of Peers: 7</div><div>Hostname: gfs03</div><div>Uuid: 4a2d4deb-f8dd-49fc-a2ab-74e39dc25e20</div><div>State: Peer in Cluster (Connected)</div><div>Hostname: gfs08</div><div>Uuid: 17705b3a-ed6f-4123-8e2e-4dc5ab6d807d</div><div>State: Peer in Cluster (Connected)</div><div>Hostname: gfs07</div><div>Uuid: dd699f55-1a27-4e51-b864-b4600d630732</div><div>State: Peer in Cluster (Connected)</div><div>Hostname: gfs06</div><div>Uuid: 8eb2a965-2c1e-4a64-b5b5-b7b7136ddede</div><div>State: Peer in Cluster (Connected)</div><div>Hostname: gfs04<br></div><div>Uuid: cd866191-f767-40d0-bf7b-81ca0bc032b7</div><div>State: Peer in Cluster (Connected)</div><div>Hostname: gfs02<br></div><div>Uuid: 6864c6ac-6ff4-423a-ae3c-f5fd25621851</div><div>State: Peer in Cluster (Connected)</div><div>Hostname: gfs05<br></div><div>Uuid: dcecb55a-87b8-4441-ab09-b52e485e5f62</div><div>State: Peer in Cluster (Connected)</div></div><div><br></div><div>All gluster nodes are running glusterfs 4.0.2<br>The clients accessing the files are also running glusterfs 4.0.2 <br>Both are Ubuntu<br><br></div><div>Thanks!</div></div></div></div>_______________________________________________<br>Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" rel="noreferrer" target="_blank">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a></blockquote></div></div>
</blockquote></div>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" rel="noreferrer" target="_blank">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a></blockquote></div></div></div>
</blockquote></div>
</blockquote></div></div>