<div dir="ltr">I think the following messages are not harmful;<div><br></div><div><span style="color:rgb(0,0,0)">[2021-01-26 19:28:40.652898] W [MSGID: 101159] [inode.c:1212:__inode_unlink] 0-inode: be318638-e8a0-4c6d-977d-7a937a</span><span style="color:rgb(0,0,0)">a84806/48bb5288-e27e-46c9-</span><span style="color:rgb(0,0,0)">9f7c-944a804df361.1: dentry not found in 48bb5288-e27e-46c9-9f7c-944a80</span><span style="color:rgb(0,0,0)">4df361</span><br style="color:rgb(0,0,0)"><span style="color:rgb(0,0,0)">[2021-01-26 19:28:40.652975] W [MSGID: 101159] [inode.c:1212:__inode_unlink] 0-inode: be318638-e8a0-4c6d-977d-7a937a</span><span style="color:rgb(0,0,0)">a84806/931508ed-9368-4982-</span><span style="color:rgb(0,0,0)">a53e-7187a9f0c1f9.3: dentry not found in 931508ed-9368-4982-a53e-7187a9</span><span style="color:rgb(0,0,0)">f0c1f9</span><br style="color:rgb(0,0,0)"><span style="color:rgb(0,0,0)">[2021-01-26 19:28:40.653047] W [MSGID: 101159] [inode.c:1212:__inode_unlink] 0-inode: be318638-e8a0-4c6d-977d-7a937a</span><span style="color:rgb(0,0,0)">a84806/e808ecab-2e70-4ef3-</span><span style="color:rgb(0,0,0)">954e-ce1b78ed8b52.4: dentry not found in e808ecab-2e70-4ef3-954e-ce1b78</span><span style="color:rgb(0,0,0)">ed8b52</span><br style="color:rgb(0,0,0)"><span style="color:rgb(0,0,0)">[2021-01-26 19:28:40.653102] W [MSGID: 101159] [inode.c:1212:__inode_unlink] 0-inode: be318638-e8a0-4c6d-977d-7a937a</span><span style="color:rgb(0,0,0)">a84806/2c62c383-d869-4655-</span><span style="color:rgb(0,0,0)">9c03-f08a86a874ba.6: dentry not found in 2c62c383-d869-4655-9c03-f08a86</span><span style="color:rgb(0,0,0)">a874ba</span><br style="color:rgb(0,0,0)"><span style="color:rgb(0,0,0)">[2021-01-26 19:28:40.653169] W [MSGID: 101159] [inode.c:1212:__inode_unlink] 0-inode: be318638-e8a0-4c6d-977d-7a937a</span><span style="color:rgb(0,0,0)">a84806/556ffbc9-bcbe-445a-</span><span style="color:rgb(0,0,0)">93f5-13784c5a6df1.2: dentry not found in 556ffbc9-bcbe-445a-93f5-13784c</span><span style="color:rgb(0,0,0)">5a6df1</span><br style="color:rgb(0,0,0)"><span style="color:rgb(0,0,0)">[2021-01-26 19:28:40.653218] W [MSGID: 101159] [inode.c:1212:__inode_unlink] 0-inode: be318638-e8a0-4c6d-977d-7a937a</span><span style="color:rgb(0,0,0)">a84806/5d414e7c-335d-40da-</span><span style="color:rgb(0,0,0)">bb96-6c427181338b.5: dentry not found in 5d414e7c-335d-40da-bb96-6c4271</span><span style="color:rgb(0,0,0)">81338b</span><br style="color:rgb(0,0,0)"><span style="color:rgb(0,0,0)">[2021-01-26 19:28:40.653314] W [MSGID: 101159] [inode.c:1212:__inode_unlink] 0-inode: be318638-e8a0-4c6d-977d-7a937a</span><span style="color:rgb(0,0,0)">a84806/43364dc9-2d8e-4fca-</span><span style="color:rgb(0,0,0)">89d2-e11dee6fcfd4.8: dentry not found in 43364dc9-2d8e-4fca-89d2-e11dee</span><span style="color:rgb(0,0,0)">6fcfd4</span><br></div><div><span style="color:rgb(0,0,0)"><br></span></div><div><font color="#000000">Also, I would like to point that I have VMs with large disks 1TB and 2TB, and have no issues. </font>definitely<font color="#000000"> would upgrade Gluster version like let's say at least 7.9.</font></div><div><font color="#000000">Amar also asked a question regarding enabling Sharding in the volume after creating the VMs disks, which would certainly mess up the volume if that what happened.</font></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jan 27, 2021 at 5:28 PM Erik Jacobson <<a href="mailto:erik.jacobson@hpe.com">erik.jacobson@hpe.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">> > Shortly after the sharded volume is made, there are some fuse mount<br>
> > messages. I'm not 100% sure if this was just before or during the<br>
> > big qemu-img command to make the 5T image<br>
> > (qemu-img create -f raw -o preallocation=falloc<br>
> > /adminvm/images/adminvm.img 5T)<br>
> Any reason to have a single disk with this size ?<br>
<br>
> Usually in any<br>
> virtualization I have used , it is always recommended to keep it lower.<br>
> Have you thought about multiple disks with smaller size ?<br>
<br>
Yes, because the actual virtual machine is an admin node/head node cluster<br>
manager for a supercomputer that hosts big OS images and drives<br>
multi-thousand-node-clusters (boot, monitoring, image creation,<br>
distribution, sometimes NFS roots, etc) . So this VM is a biggie.<br>
<br>
We could make multiple smaller images but it would be very painful since<br>
it differs from the normal non-VM setup.<br>
<br>
So unlike many solutions where you have lots of small VMs with their<br>
images small images, this solution is one giant VM with one giant image.<br>
We're essentially using gluster in this use case (as opposed to others I<br>
have posted about in the past) for head node failover (combined with<br>
pacemaker).<br>
<br>
> Also worth<br>
> noting is that RHII is supported only when the shard size is 512MB, so<br>
> it's worth trying bigger shard size .<br>
<br>
I have put larger shard size and newer gluster version on the list to<br>
try. Thank you! Hoping to get it failing again to try these things!<br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr">Respectfully<div>Mahdi</div></div></div>