<div dir="ltr">Have sent the unsubscribe request, please click on the link received in your email and confirm the same.<div><br></div><div>Thanks</div><div>Saju<br><div><br></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Oct 6, 2020 at 3:00 AM Tami Greene <<a href="mailto:tmgreene364@gmail.com">tmgreene364@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">I have attempted to remove myself, but continue due to receive "illegal<br>
email address" reply with my attempt. Thank you.<br>
<br>
On Mon, Oct 5, 2020, 4:37 PM Felix Kölzow <<a href="mailto:felix.koelzow@gmx.de" target="_blank">felix.koelzow@gmx.de</a>> wrote:<br>
<br>
> Dear Matthew,<br>
><br>
><br>
> from my current experience with gluster geo-replication and since this is<br>
> a key in your backup-procedure<br>
><br>
> (this is how it seems to me), I would come up with a new one, just to be<br>
> sure.<br>
><br>
><br>
> Regards,<br>
><br>
> Felix<br>
><br>
><br>
> On 05/10/2020 22:28, Matthew Benstead wrote:<br>
><br>
> Hmm... Looks like I forgot to set the xattr's to sa - I left them as<br>
> default.<br>
><br>
> [root@pcic-backup01 ~]# zfs get xattr pcic-backup01-zpool<br>
> NAME PROPERTY VALUE SOURCE<br>
> pcic-backup01-zpool xattr on default<br>
><br>
> [root@pcic-backup02 ~]# zfs get xattr pcic-backup02-zpool<br>
> NAME PROPERTY VALUE SOURCE<br>
> pcic-backup02-zpool xattr on default<br>
><br>
> I wonder if I can change them and continue, or if I need to blow away the<br>
> zpool and start over?<br>
><br>
> Thanks,<br>
> -Matthew<br>
><br>
> --<br>
> Matthew Benstead<br>
> System Administrator<br>
> Pacific Climate Impacts Consortium <<a href="https://pacificclimate.org/" rel="noreferrer" target="_blank">https://pacificclimate.org/</a>><br>
> University of Victoria, UH1<br>
> PO Box 1800, STN CSC<br>
> Victoria, BC, V8W 2Y2<br>
> Phone: +1-250-721-8432<br>
> Email: <a href="mailto:matthewb@uvic.ca" target="_blank">matthewb@uvic.ca</a><br>
> On 10/5/20 12:53 PM, Felix Kölzow wrote:<br>
><br>
> Dear Matthew,<br>
><br>
> this is our configuration:<br>
><br>
> zfs get all mypool<br>
><br>
> mypool xattr sa<br>
> local<br>
> mypool acltype posixacl<br>
> local<br>
><br>
><br>
> Something more to consider?<br>
><br>
><br>
> Regards,<br>
><br>
> Felix<br>
><br>
><br>
><br>
> On 05/10/2020 21:11, Matthew Benstead wrote:<br>
><br>
> Thanks Felix - looking through some more of the logs I may have found the<br>
> reason...<br>
><br>
> From<br>
> /var/log/glusterfs/geo-replication/storage_10.0.231.81_pcic-backup/mnt-data-storage_a-storage.log<br>
><br>
> [2020-10-05 18:13:35.736838] E [fuse-bridge.c:4288:fuse_xattr_cbk]<br>
> 0-glusterfs-fuse: extended attribute not supported by the backend storage<br>
> [2020-10-05 18:18:53.885591] E [fuse-bridge.c:4288:fuse_xattr_cbk]<br>
> 0-glusterfs-fuse: extended attribute not supported by the backend storage<br>
> [2020-10-05 18:22:14.405234] E [fuse-bridge.c:4288:fuse_xattr_cbk]<br>
> 0-glusterfs-fuse: extended attribute not supported by the backend storage<br>
> [2020-10-05 18:25:53.971679] E [fuse-bridge.c:4288:fuse_xattr_cbk]<br>
> 0-glusterfs-fuse: extended attribute not supported by the backend storage<br>
> [2020-10-05 18:31:44.571557] E [fuse-bridge.c:4288:fuse_xattr_cbk]<br>
> 0-glusterfs-fuse: extended attribute not supported by the backend storage<br>
> [2020-10-05 18:36:36.508772] E [fuse-bridge.c:4288:fuse_xattr_cbk]<br>
> 0-glusterfs-fuse: extended attribute not supported by the backend storage<br>
> [2020-10-05 18:40:10.401055] E [fuse-bridge.c:4288:fuse_xattr_cbk]<br>
> 0-glusterfs-fuse: extended attribute not supported by the backend storage<br>
> [2020-10-05 18:42:57.833536] E [fuse-bridge.c:4288:fuse_xattr_cbk]<br>
> 0-glusterfs-fuse: extended attribute not supported by the backend storage<br>
> [2020-10-05 18:45:19.691953] E [fuse-bridge.c:4288:fuse_xattr_cbk]<br>
> 0-glusterfs-fuse: extended attribute not supported by the backend storage<br>
> [2020-10-05 18:48:26.478532] E [fuse-bridge.c:4288:fuse_xattr_cbk]<br>
> 0-glusterfs-fuse: extended attribute not supported by the backend storage<br>
> [2020-10-05 18:52:24.466914] E [fuse-bridge.c:4288:fuse_xattr_cbk]<br>
> 0-glusterfs-fuse: extended attribute not supported by the backend storage<br>
><br>
><br>
> The slave nodes are running gluster on top of ZFS, but I had configured<br>
> ACLs - is there something else missing to make this work with ZFS?<br>
><br>
> [root@pcic-backup01 ~]# gluster volume info<br>
><br>
> Volume Name: pcic-backup<br>
> Type: Distribute<br>
> Volume ID: 7af8a424-f4b6-4405-bba1-0dbafb0fa231<br>
> Status: Started<br>
> Snapshot Count: 0<br>
> Number of Bricks: 2<br>
> Transport-type: tcp<br>
> Bricks:<br>
> Brick1: 10.0.231.81:/pcic-backup01-zpool/brick<br>
> Brick2: 10.0.231.82:/pcic-backup02-zpool/brick<br>
> Options Reconfigured:<br>
> network.ping-timeout: 10<br>
> performance.cache-size: 256MB<br>
> server.event-threads: 4<br>
> client.event-threads: 4<br>
> cluster.lookup-optimize: on<br>
> performance.parallel-readdir: on<br>
> performance.readdir-ahead: on<br>
> features.quota-deem-statfs: on<br>
> features.inode-quota: on<br>
> features.quota: on<br>
> transport.address-family: inet<br>
> nfs.disable: on<br>
> features.read-only: off<br>
> performance.open-behind: off<br>
><br>
><br>
> [root@pcic-backup01 ~]# zfs get acltype pcic-backup01-zpool<br>
> NAME PROPERTY VALUE SOURCE<br>
> pcic-backup01-zpool acltype posixacl local<br>
><br>
> [root@pcic-backup01 ~]# grep "pcic-backup0" /proc/mounts<br>
> pcic-backup01-zpool /pcic-backup01-zpool zfs rw,seclabel,xattr,posixacl 0 0<br>
><br>
><br>
> [root@pcic-backup02 ~]# zfs get acltype pcic-backup02-zpool<br>
> NAME PROPERTY VALUE SOURCE<br>
> pcic-backup02-zpool acltype posixacl local<br>
><br>
> [root@pcic-backup02 ~]# grep "pcic-backup0" /proc/mounts<br>
> pcic-backup02-zpool /pcic-backup02-zpool zfs rw,seclabel,xattr,posixacl 0 0<br>
><br>
> Thanks,<br>
> -Matthew<br>
><br>
><br>
> --<br>
> Matthew Benstead<br>
> System Administrator<br>
> Pacific Climate Impacts Consortium <<a href="https://pacificclimate.org/" rel="noreferrer" target="_blank">https://pacificclimate.org/</a>><br>
> University of Victoria, UH1<br>
> PO Box 1800, STN CSC<br>
> Victoria, BC, V8W 2Y2<br>
> Phone: +1-250-721-8432<br>
> Email: <a href="mailto:matthewb@uvic.ca" target="_blank">matthewb@uvic.ca</a><br>
> On 10/5/20 1:39 AM, Felix Kölzow wrote:<br>
><br>
> Dear Matthew,<br>
><br>
><br>
> can you provide more information regarding to the geo-replication brick<br>
> logs.<br>
><br>
> These files area also located in:<br>
><br>
> /var/log/glusterfs/geo-replication/storage_10.0.231.81_pcic-backup/<br>
><br>
><br>
> Usually, these log files are more precise to figure out the root cause<br>
> of the error.<br>
><br>
> Additionally, it is also worth to look at the log-files on the slave side</blockquote></div>