<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
Hi Nithya, <br>
<br>
I've completed this, and attached the log.<br>
<br>
<tt>[root@gluster07 ~]# getfattr --absolute-names -m . -d -e hex
/mnt/raid6-storage/storage/ </tt><tt><br>
</tt><tt># file: /mnt/raid6-storage/storage/</tt><tt><br>
</tt><tt>security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a756e6c6162656c65645f743a733000</tt><tt><br>
</tt><tt>trusted.gfid=0x00000000000000000000000000000001</tt><tt><br>
</tt><tt>trusted.glusterfs.6f95525a-94d7-4174-bac4-e1a18fe010a2.xtime=0x5d31d426000cee76</tt><tt><br>
</tt><tt>trusted.glusterfs.quota.dirty=0x3000</tt><tt><br>
</tt><tt>trusted.glusterfs.quota.size.2=0x00001b73f79d92000000000000764c7a000000000005ce79</tt><tt><br>
</tt><tt>trusted.glusterfs.volume-id=0x6f95525a94d74174bac4e1a18fe010a2</tt><tt><br>
</tt><tt><br>
</tt><tt>[root@gluster07 ~]# gluster volume get storage
client-log-level </tt><tt><br>
</tt><tt>Option
Value </tt><tt><br>
</tt><tt>------
----- </tt><tt><br>
</tt><tt>diagnostics.client-log-level
INFO </tt><tt><br>
</tt><tt><br>
</tt><tt>[root@gluster07 ~]# gluster volume set storage
client-log-level DEBUG</tt><tt><br>
</tt><tt>volume set: success</tt><tt><br>
</tt><tt><br>
</tt><tt>[root@gluster07 ~]# umount /storage/</tt><tt><br>
</tt><tt>umount: /storage/: not mounted</tt><tt><br>
</tt><tt><br>
</tt><tt>[root@gluster07 ~]# mount /storage/</tt><tt><br>
</tt><tt><br>
</tt><tt>[root@gluster07 ~]# stat /storage/</tt><tt><br>
</tt><tt> File: ‘/storage/’</tt><tt><br>
</tt><tt> Size: 4096 Blocks: 8 IO Block: 131072
directory</tt><tt><br>
</tt><tt>Device: 2bh/43d Inode: 1 Links: 6</tt><tt><br>
</tt><tt>Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid:
( 0/ root)</tt><tt><br>
</tt><tt>Context: system_u:object_r:fusefs_t:s0</tt><tt><br>
</tt><tt>Access: 2019-07-19 08:01:17.458527914 -0700</tt><tt><br>
</tt><tt>Modify: 2018-07-04 15:18:05.947569905 -0700</tt><tt><br>
</tt><tt>Change: 2019-07-19 08:01:10.350465738 -0700</tt><tt><br>
</tt><tt> Birth: -</tt><tt><br>
</tt><tt><br>
</tt><tt>[root@gluster07 ~]# gluster volume set storage
client-log-level INFO</tt><tt><br>
</tt><tt>volume set: success</tt><tt><br>
</tt><tt><br>
</tt><tt>[root@gluster07 ~]# getfattr --absolute-names -m . -d -e
hex /mnt/raid6-storage/storage/ </tt><tt><br>
</tt><tt># file: /mnt/raid6-storage/storage/</tt><tt><br>
</tt><tt>security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a756e6c6162656c65645f743a733000</tt><tt><br>
</tt><tt>trusted.gfid=0x00000000000000000000000000000001</tt><tt><br>
</tt><tt>trusted.glusterfs.6f95525a-94d7-4174-bac4-e1a18fe010a2.xtime=0x5d31dafd000a5aa3</tt><tt><br>
</tt><tt>trusted.glusterfs.quota.dirty=0x3000</tt><tt><br>
</tt><tt>trusted.glusterfs.quota.size.2=0x00001b73f79da0000000000000764c7a000000000005ce79</tt><tt><br>
</tt><tt>trusted.glusterfs.volume-id=0x6f95525a94d74174bac4e1a18fe010a2</tt><br>
<br>
<br>
Thanks,<br>
-Matthew<br>
<div class="moz-signature"><font size="-1">
<p><br>
</p>
</font>
</div>
<div class="moz-cite-prefix">On 7/18/19 9:00 PM, Nithya Balachandran
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAOUCJ=iD=ehOtqveU_jsO=fwjMc-00J2MmBVFXtew=X-78rNcw@mail.gmail.com">
<div dir="ltr">Hi Mathew,
<div><br>
</div>
<div>Could you send me the log file for this mount point after
doing the following:</div>
<div><br>
</div>
<div>
<ol>
<li>gluster v set <volname> client-log-level DEBUG</li>
<li>unmount and remount the volume</li>
<li>stat <mountpoint></li>
<li>gluster v set <volname> client-log-level INFO</li>
</ol>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Regards,</div>
<div>Nithya</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Thu, 18 Jul 2019 at 19:49,
Matthew Benstead <<a href="mailto:matthewb@uvic.ca"
moz-do-not-send="true">matthewb@uvic.ca</a>> wrote:<br>
</div>
<blockquote class="gmail_quote">
<div> Hi Nithya, <br>
<br>
No - it was added about a year and a half ago. I have tried
re-mounting the volume on the server, but it didn't add the
attr: <br>
<br>
<tt>[root@gluster07 ~]# umount /storage/<br>
[root@gluster07 ~]# cat /etc/fstab | grep "/storage"</tt><tt><br>
</tt><tt>10.0.231.56:/storage /storage glusterfs
defaults,log-level=WARNING,backupvolfile-server=10.0.231.51
0 0</tt><tt><br>
</tt><tt>[root@gluster07 ~]# mount /storage/</tt><tt><br>
</tt><tt>[root@gluster07 ~]# df -h /storage/</tt><tt><br>
</tt><tt>Filesystem Size Used Avail Use% Mounted
on</tt><tt><br>
</tt><tt>10.0.231.56:/storage 255T 194T 62T 77%
/storage</tt><tt><br>
</tt><tt>[root@gluster07 ~]# getfattr --absolute-names -m .
-d -e hex /mnt/raid6-storage/storage/ </tt><tt><br>
</tt><tt># file: /mnt/raid6-storage/storage/</tt><tt><br>
</tt><tt>security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a756e6c6162656c65645f743a733000</tt><tt><br>
</tt><tt>trusted.gfid=0x00000000000000000000000000000001</tt><tt><br>
</tt><tt>trusted.glusterfs.6f95525a-94d7-4174-bac4-e1a18fe010a2.xtime=0x5d307baa00023ec0</tt><tt><br>
</tt><tt>trusted.glusterfs.quota.dirty=0x3000</tt><tt><br>
</tt><tt>trusted.glusterfs.quota.size.2=0x00001b71d5279e000000000000763e32000000000005cd53</tt><tt><br>
</tt><tt>trusted.glusterfs.volume-id=0x6f95525a94d74174bac4e1a18fe010a2</tt><br>
<br>
Thanks,<br>
-Matthew<br>
<div class="gmail-m_-8771514128361562276moz-cite-prefix"><br>
On 7/17/19 10:04 PM, Nithya Balachandran wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hi Matthew,
<div><br>
</div>
<div>Was this node/brick added to the volume recently?
If yes, try mounting the volume on a fresh mount point
- that should create the xattr on this as well.</div>
<div><br>
</div>
<div>Regards,</div>
<div>Nithya</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Wed, 17 Jul 2019 at
21:01, Matthew Benstead <<a
href="mailto:matthewb@uvic.ca" target="_blank"
moz-do-not-send="true">matthewb@uvic.ca</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote">Hello,<br>
<br>
I've just noticed one brick in my 7 node distribute
volume is missing<br>
the trusted.glusterfs.dht xattr...? How can I fix
this?<br>
<br>
I'm running glusterfs-5.3-2.el7.x86_64 on CentOS 7.<br>
<br>
All of the other nodes are fine, but gluster07 from
the list below does<br>
not have the attribute.<br>
<br>
$ ansible -i hosts gluster-servers[0:6] ... -m shell
-a "getfattr -m .<br>
--absolute-names -n trusted.glusterfs.dht -e hex<br>
/mnt/raid6-storage/storage"<br>
...<br>
gluster05 | SUCCESS | rc=0 >><br>
# file: /mnt/raid6-storage/storage<br>
trusted.glusterfs.dht=0x0000000100000000000000002aaaaaa9<br>
<br>
gluster03 | SUCCESS | rc=0 >><br>
# file: /mnt/raid6-storage/storage<br>
trusted.glusterfs.dht=0x0000000100000000aaaaaaa8d5555551<br>
<br>
gluster04 | SUCCESS | rc=0 >><br>
# file: /mnt/raid6-storage/storage<br>
trusted.glusterfs.dht=0x0000000100000000d5555552ffffffff<br>
<br>
gluster06 | SUCCESS | rc=0 >><br>
# file: /mnt/raid6-storage/storage<br>
trusted.glusterfs.dht=0x00000001000000002aaaaaaa55555553<br>
<br>
gluster02 | SUCCESS | rc=0 >><br>
# file: /mnt/raid6-storage/storage<br>
trusted.glusterfs.dht=0x00000001000000007ffffffeaaaaaaa7<br>
<br>
gluster07 | FAILED | rc=1 >><br>
/mnt/raid6-storage/storage: trusted.glusterfs.dht: No
such<br>
attributenon-zero return code<br>
<br>
gluster01 | SUCCESS | rc=0 >><br>
# file: /mnt/raid6-storage/storage<br>
trusted.glusterfs.dht=0x0000000100000000555555547ffffffd<br>
<br>
Here are all of the attr's from the brick:<br>
<br>
[root@gluster07 ~]# getfattr --absolute-names -m . -d
-e hex<br>
/mnt/raid6-storage/storage/<br>
# file: /mnt/raid6-storage/storage/<br>
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a756e6c6162656c65645f743a733000<br>
trusted.gfid=0x00000000000000000000000000000001<br>
trusted.glusterfs.6f95525a-94d7-4174-bac4-e1a18fe010a2.xtime=0x5d2dee800001fdf9<br>
trusted.glusterfs.quota.dirty=0x3000<br>
trusted.glusterfs.quota.size.2=0x00001b69498a1400000000000076332e000000000005cd03<br>
trusted.glusterfs.volume-id=0x6f95525a94d74174bac4e1a18fe010a2<br>
<br>
<br>
And here is the volume information:<br>
<br>
[root@gluster07 ~]# gluster volume info storage<br>
<br>
Volume Name: storage<br>
Type: Distribute<br>
Volume ID: 6f95525a-94d7-4174-bac4-e1a18fe010a2<br>
Status: Started<br>
Snapshot Count: 0<br>
Number of Bricks: 7<br>
Transport-type: tcp<br>
Bricks:<br>
Brick1: 10.0.231.50:/mnt/raid6-storage/storage<br>
Brick2: 10.0.231.51:/mnt/raid6-storage/storage<br>
Brick3: 10.0.231.52:/mnt/raid6-storage/storage<br>
Brick4: 10.0.231.53:/mnt/raid6-storage/storage<br>
Brick5: 10.0.231.54:/mnt/raid6-storage/storage<br>
Brick6: 10.0.231.55:/mnt/raid6-storage/storage<br>
Brick7: 10.0.231.56:/mnt/raid6-storage/storage<br>
Options Reconfigured:<br>
changelog.changelog: on<br>
features.quota-deem-statfs: on<br>
features.read-only: off<br>
features.inode-quota: on<br>
features.quota: on<br>
performance.readdir-ahead: on<br>
nfs.disable: on<br>
geo-replication.indexing: on<br>
geo-replication.ignore-pid-check: on<br>
transport.address-family: inet<br>
<br>
Thanks,<br>
-Matthew<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org"
target="_blank" moz-do-not-send="true">Gluster-users@gluster.org</a><br>
<a
href="https://lists.gluster.org/mailman/listinfo/gluster-users"
rel="noreferrer" target="_blank"
moz-do-not-send="true">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
</blockquote>
</div>
</blockquote>
<br>
</div>
</blockquote>
</div>
</blockquote>
<br>
</body>
</html>