[Gluster-users] Advice on moving volumes/bricks to new servers

[Ronny Adsetts]

Ronny Adsetts wrote on 01/03/2020 00:02:
[...]
> 
> When I look at the FUSE-mounted volume, the file is there and correct
> but the file permissions of this and lots of others are screwed. Lots
> of dirs with d--------- permissions, lots of root:root owned files.

Replying to myself here...

I tried a second add-brick/remove-brick test which completed fine this time and all subvolumes were migrated to the new servers. I specifically checked for pending heals prior to each remove-brick.

However, I'm seeing some anomalies following the migration. During a remove-disk, as a test, I did a "mv linux-5.4.22 linux-5.4.22-orig" and the linux-5.4.22-orig folder has issues:

1. We're seeing lots of directories with "d---------" permissions and owned by root:root. Not all but more than 0 is a worry.

2. The folder has files missing. Diff shows 5717 files. This is obviously unexpected.

$ sudo du -s linux-5.4.22 linux-5.4.22-orig2 linux-5.4.22-orig
898898  linux-5.4.22
898898  linux-5.4.22-orig2
830588  linux-5.4.22-orig

$ ls -ald linux-5.4.22*
drwxr-xr-x 24 ronny allusers      4096 Feb 24 07:37 linux-5.4.22
d--------- 24 root  root          4096 Mar  2 12:17 linux-5.4.22-orig
drwxr-xr-x 24 ronny allusers      4096 Feb 24 07:37 linux-5.4.22-orig2
-rw-r--r--  1 ronny allusers 109491488 Feb 24 07:44 linux-5.4.22.tar.xz

$ sudo ls -al linux-5.4.22-orig
total 807
d---------  24 root  root       4096 Mar  2 12:17 .
drwxr-xr-x   9 ronny allusers   4096 Mar  2 14:08 ..
d---------  27 root  root       4096 Mar  2 12:33 arch
d---------   3 root  root       4096 Mar  2 12:34 block
d---------   2 root  root       4096 Mar  2 12:16 certs
-rw-r--r--   1 ronny allusers  15318 Feb 24 07:37 .clang-format
-rw-r--r--   1 ronny allusers     59 Feb 24 07:37 .cocciconfig
-rw-r--r--   1 ronny allusers    423 Feb 24 07:37 COPYING
-rw-r--r--   1 ronny allusers  99537 Feb 24 07:37 CREDITS
d---------   4 root  root       4096 Mar  2 12:34 crypto
drwxr-xr-x  82 ronny allusers   4096 Mar  2 12:44 Documentation
drwxr-xr-x 138 ronny allusers   4096 Mar  2 12:16 drivers
drwxr-xr-x  76 ronny allusers   4096 Mar  2 12:35 fs
-rw-r--r--   1 ronny allusers     71 Feb 24 07:37 .get_maintainer.ignore
-rw-r--r--   1 ronny allusers     30 Feb 24 07:37 .gitattributes
-rw-r--r--   1 ronny allusers   1740 Feb 24 07:37 .gitignore
drwxr-xr-x  27 ronny allusers   4096 Mar  2 12:16 include
d---------   2 root  root       4096 Mar  2 12:17 init
d---------   2 root  root       4096 Mar  2 12:35 ipc
-rw-r--r--   1 ronny allusers   1321 Feb 24 07:37 Kbuild
-rw-r--r--   1 ronny allusers    595 Feb 24 07:37 Kconfig
d---------  18 root  root       4096 Mar  2 12:17 kernel
d---------  18 root  root       4096 Mar  2 12:44 lib
d---------   6 root  root       4096 Mar  2 12:15 LICENSES
-rw-r--r--   1 ronny allusers  13825 Feb 24 07:37 .mailmap
-rw-r--r--   1 ronny allusers 529379 Feb 24 07:37 MAINTAINERS
-rw-r--r--   1 ronny allusers  60910 Feb 24 07:37 Makefile
d---------   3 root  root       4096 Mar  2 12:17 mm
drwxr-xr-x  70 ronny allusers   4096 Mar  2 12:17 net
-rw-r--r--   1 ronny allusers    727 Feb 24 07:37 README
drwxr-xr-x  29 ronny allusers   4096 Mar  2 12:17 samples
d---------  15 root  root       4096 Mar  2 12:44 scripts
drwxr-xr-x  12 ronny allusers   4096 Mar  2 12:35 security
d---------  26 root  root       4096 Mar  2 12:17 sound
drwxr-xr-x  35 ronny allusers   4096 Mar  2 12:45 tools
d---------   3 root  root       4096 Mar  2 12:35 usr
drwxr-xr-x   4 ronny allusers   4096 Mar  2 12:44 virt


Have I missed something in doing the remove-brick? Trying to get to the bottom of this before I press go on production data.

Thanks.

Ronny

-- 
Ronny Adsetts
Technical Director
Amazing Internet Ltd, London
t: +44 20 8977 8943
w: www.amazinginternet.com

Registered office: 85 Waldegrave Park, Twickenham, TW1 4TJ
Registered in England. Company No. 4042957


-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 195 bytes
Desc: OpenPGP digital signature
URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20200302/33da3975/attachment.sig>