[Gluster-users] Really long df-h and high swap usage after rsync 3.7.11

[Marco Lorenzo Crociani]

Hello,
I have done a swapoff and then the df -h run fast.

# free -m
               total        used        free      shared buff/cache   
available
Mem:           7958        5720         280          16 1956        1825
Swap:             0           0           0


time df -h
real    0m0.054s
user    0m0.000s
sys    0m0.003s

Should I reduce swappiness? Now it is 60.
Is it really needed all that ram to mount twelve glusterfs volumes ( 
~3764 GB )?

Regards,

-- 
Marco Crociani
Prisma Telecom Testing S.r.l.
via Petrocchi, 4  20127 MILANO  ITALY
Phone:  +39 02 26113507
Fax:  +39 02 26113597
e-mail:  marcoc at prismatelecomtesting.com
web:  http://www.prismatelecomtesting.com




On 20/07/2016 11:46, Marco Lorenzo Crociani wrote:
> Hi,
> I have a CentOS7 with rsnapshot that mount glusterfs volume and do 
> backups every day.
>
> # yum list installed |grep glusterfs
> glusterfs.x86_64                       3.7.11-1.el7
> glusterfs-api.x86_64                   3.7.11-1.el7
> glusterfs-client-xlators.x86_64        3.7.11-1.el7
> glusterfs-fuse.x86_64                  3.7.11-1.el7
> glusterfs-libs.x86_64                  3.7.11-1.el7
>
> # free -m
>               total        used        free      shared buff/cache   
> available
> Mem:           7958        3401         213           4 4343        4146
> Swap:          8063        2467        5596
>
>
> After running the backups df -h is really slow:
>
> # time df -h
> File system                   Dim. Usati Dispon. Uso% Montato su
> [.....]
> s25gfs.ovirt:VOL_***          100G   40G     61G  40% /mnt/VOL_***
> s25gfs.ovirt:VOL_***         100G   50G     51G  50% /mnt/VOL_***
> s25gfs.ovirt:VOL_***        200G  138G     63G  69% /mnt/VOL_***
> s25gfs.ovirt:VOL_***         500G  412G     89G  83% /mnt/VOL_***
> s25gfs.ovirt:VOL_***          500G  246G    255G  50% /mnt/VOL_***
> s25gfs.ovirt:VOL_***     200G   98G    103G  49% /mnt/VOL_***
> s25gfs.ovirt:VOL_***        200G   90G    111G  45% /mnt/VOL_***
> s25gfs.ovirt:VOL_***      100G   43G     58G  43% /mnt/VOL_***
> s25gfs.ovirt:VOL_***        500G  385G    116G  77% /mnt/VOL_***
> s25gfs.ovirt:VOL_***     100G   52G     49G  52% /mnt/VOL_***
> s25gfs.ovirt:VOL_***        100G   15G     86G  15% /mnt/VOL_***
> s25gfs.ovirt:VOL_***   400G  348G     53G  87% /mnt/VOL_***
>
> real    0m24.068s
> user    0m0.003s
> sys    0m0.002s
>
> while on another machine it took:
> real    0m0.057s
> user    0m0.000s
> sys    0m0.006s
>
> after umounting all gluster volumes and mounting those back:
>
> # free -m
>               total        used        free      shared buff/cache   
> available
> Mem:           7958         652        3014           4 4291        6915
> Swap:          8063          55        8008
>
> time df -h
> real    0m0.037s
> user    0m0.001s
> sys    0m0.002s
>
> I mount the volumes in fstab with:
> s25gfs.ovirt:VOL_***            /mnt/VOL_*** glusterfs 
> defaults,acl        0 0
>
> Is there any memory leak or something nasty?
> Regards,
>