[Gluster-devel] Glusterfs meta data space consumption issue
ABHISHEK PALIWAL
abhishpaliwal at gmail.com
Fri Apr 7 06:45:22 UTC 2017
Is there any update ??
On Thu, Apr 6, 2017 at 12:45 PM, ABHISHEK PALIWAL <abhishpaliwal at gmail.com>
wrote:
> Hi,
>
> We are currently experiencing a serious issue w.r.t volume space usage by
> glusterfs.
>
> In the below outputs, we can see that the size of the real data in /c
> (glusterfs volume) is nearly 1GB but the “.glusterfs” directory inside the
> brick (i.e., “/opt/lvmdir/c2/brick”) is consuming around 3.4 GB
>
> Can you tell us why the volume space is fully used by glusterfs even
> though the real data size is around 1GB itself ?
>
> # gluster peer status
> Number of Peers: 0
> #
> #
> # gluster volume status
> Status of volume: c_glusterfs
> Gluster process TCP Port RDMA Port Online
> Pid
> ------------------------------------------------------------
> ------------------
> Brick 10.32.0.48:/opt/lvmdir/c2/brick 49152 0 Y
> 1507
>
> Task Status of Volume c_glusterfs
> ------------------------------------------------------------
> ------------------
> There are no active volume tasks
>
> # gluster volume info
>
> Volume Name: c_glusterfs
> Type: Distribute
> Volume ID: d83b1b8c-bc37-4615-bf4b-529f56968ecc
> Status: Started
> Number of Bricks: 1
> Transport-type: tcp
> Bricks:
> Brick1: 10.32.0.48:/opt/lvmdir/c2/brick
> Options Reconfigured:
> nfs.disable: on
> network.ping-timeout: 4
> performance.readdir-ahead: on
> #
> # ls -a /c/
> . .. .trashcan RNC_Exceptions configuration java license
> loadmodules loadmodules_norepl loadmodules_tftp logfiles lost+found
> node_id pm_data pmd public_html rnc security systemfiles tmp
> toplog.txt up usr xb
> # du -sh /c/.trashcan/
> 8.0K /c/.trashcan/
> # du -sh /c/*
> 11K /c/RNC_Exceptions
> 5.5K /c/configuration
> 62M /c/java
> 138K /c/license
> 609M /c/loadmodules
> 90M /c/loadmodules_norepl
> 246M /c/loadmodules_tftp
> 4.1M /c/logfiles
> 4.0K /c/lost+found
> 5.0K /c/node_id
> 8.0K /c/pm_data
> 4.5K /c/pmd
> 9.1M /c/public_html
> 113K /c/rnc
> 16K /c/security
> 1.3M /c/systemfiles
> 228K /c/tmp
> 75K /c/toplog.txt
> 1.5M /c/up
> 4.0K /c/usr
> 4.0K /c/xb
> # du -sh /c/
> 1022M /c/
> # df -h /c/
> Filesystem Size Used Avail Use% Mounted on
> 10.32.0.48:c_glusterfs 3.6G 3.4G 0 100% /mnt/c
> #
> #
> #
> # du -sh /opt/lvmdir/c2/brick/
> 3.4G /opt/lvmdir/c2/brick/
> # du -sh /opt/lvmdir/c2/brick/*
> 112K /opt/lvmdir/c2/brick/RNC_Exceptions
> 36K /opt/lvmdir/c2/brick/configuration
> 63M /opt/lvmdir/c2/brick/java
> 176K /opt/lvmdir/c2/brick/license
> 610M /opt/lvmdir/c2/brick/loadmodules
> 95M /opt/lvmdir/c2/brick/loadmodules_norepl
> 246M /opt/lvmdir/c2/brick/loadmodules_tftp
> 4.2M /opt/lvmdir/c2/brick/logfiles
> 8.0K /opt/lvmdir/c2/brick/lost+found
> 24K /opt/lvmdir/c2/brick/node_id
> 16K /opt/lvmdir/c2/brick/pm_data
> 16K /opt/lvmdir/c2/brick/pmd
> 9.2M /opt/lvmdir/c2/brick/public_html
> 268K /opt/lvmdir/c2/brick/rnc
> 80K /opt/lvmdir/c2/brick/security
> 1.4M /opt/lvmdir/c2/brick/systemfiles
> 252K /opt/lvmdir/c2/brick/tmp
> 80K /opt/lvmdir/c2/brick/toplog.txt
> 1.5M /opt/lvmdir/c2/brick/up
> 8.0K /opt/lvmdir/c2/brick/usr
> 8.0K /opt/lvmdir/c2/brick/xb
> # du -sh /opt/lvmdir/c2/brick/.glusterfs/
> 3.4G /opt/lvmdir/c2/brick/.glusterfs/
>
> Below are the statics of the below command "du -sh /opt/lvmdir/c2/brick/.
> glusterfs/*"
>
> # du -sh /opt/lvmdir/c2/brick/.glusterfs/*
> 14M /opt/lvmdir/c2/brick/.glusterfs/00
> 8.3M /opt/lvmdir/c2/brick/.glusterfs/01
> 23M /opt/lvmdir/c2/brick/.glusterfs/02
> 17M /opt/lvmdir/c2/brick/.glusterfs/03
> 7.1M /opt/lvmdir/c2/brick/.glusterfs/04
> 336K /opt/lvmdir/c2/brick/.glusterfs/05
> 3.5M /opt/lvmdir/c2/brick/.glusterfs/06
> 1.7M /opt/lvmdir/c2/brick/.glusterfs/07
> 154M /opt/lvmdir/c2/brick/.glusterfs/08
> 14M /opt/lvmdir/c2/brick/.glusterfs/09
> 9.5M /opt/lvmdir/c2/brick/.glusterfs/0a
> 5.5M /opt/lvmdir/c2/brick/.glusterfs/0b
> 11M /opt/lvmdir/c2/brick/.glusterfs/0c
> 764K /opt/lvmdir/c2/brick/.glusterfs/0d
> 69M /opt/lvmdir/c2/brick/.glusterfs/0e
> 3.7M /opt/lvmdir/c2/brick/.glusterfs/0f
> 14M /opt/lvmdir/c2/brick/.glusterfs/10
> 1.8M /opt/lvmdir/c2/brick/.glusterfs/11
> 5.0M /opt/lvmdir/c2/brick/.glusterfs/12
> 18M /opt/lvmdir/c2/brick/.glusterfs/13
> 7.8M /opt/lvmdir/c2/brick/.glusterfs/14
> 151M /opt/lvmdir/c2/brick/.glusterfs/15
> 15M /opt/lvmdir/c2/brick/.glusterfs/16
> 9.0M /opt/lvmdir/c2/brick/.glusterfs/17
> 11M /opt/lvmdir/c2/brick/.glusterfs/18
> 3.1M /opt/lvmdir/c2/brick/.glusterfs/19
> 8.1M /opt/lvmdir/c2/brick/.glusterfs/1a
> 82M /opt/lvmdir/c2/brick/.glusterfs/1b
> 95M /opt/lvmdir/c2/brick/.glusterfs/1c
> 2.1M /opt/lvmdir/c2/brick/.glusterfs/1d
> 4.5M /opt/lvmdir/c2/brick/.glusterfs/1e
> 9.7M /opt/lvmdir/c2/brick/.glusterfs/1f
> 13M /opt/lvmdir/c2/brick/.glusterfs/20
> 54M /opt/lvmdir/c2/brick/.glusterfs/21
> 9.4M /opt/lvmdir/c2/brick/.glusterfs/22
> 2.3M /opt/lvmdir/c2/brick/.glusterfs/23
> 14M /opt/lvmdir/c2/brick/.glusterfs/24
> 12M /opt/lvmdir/c2/brick/.glusterfs/25
> 56M /opt/lvmdir/c2/brick/.glusterfs/26
> 5.6M /opt/lvmdir/c2/brick/.glusterfs/27
> 2.5M /opt/lvmdir/c2/brick/.glusterfs/28
> 55M /opt/lvmdir/c2/brick/.glusterfs/29
> 47M /opt/lvmdir/c2/brick/.glusterfs/2a
> 6.1M /opt/lvmdir/c2/brick/.glusterfs/2b
> 2.2M /opt/lvmdir/c2/brick/.glusterfs/2c
> 4.7M /opt/lvmdir/c2/brick/.glusterfs/2d
> 52M /opt/lvmdir/c2/brick/.glusterfs/2e
> 16M /opt/lvmdir/c2/brick/.glusterfs/2f
> 2.3M /opt/lvmdir/c2/brick/.glusterfs/30
> 7.6M /opt/lvmdir/c2/brick/.glusterfs/31
> 12M /opt/lvmdir/c2/brick/.glusterfs/32
> 2.3M /opt/lvmdir/c2/brick/.glusterfs/33
> 4.5M /opt/lvmdir/c2/brick/.glusterfs/34
> 1.5M /opt/lvmdir/c2/brick/.glusterfs/35
> 24M /opt/lvmdir/c2/brick/.glusterfs/36
> 6.8M /opt/lvmdir/c2/brick/.glusterfs/37
> 10M /opt/lvmdir/c2/brick/.glusterfs/38
> 5.0M /opt/lvmdir/c2/brick/.glusterfs/39
> 21M /opt/lvmdir/c2/brick/.glusterfs/3a
> 9.6M /opt/lvmdir/c2/brick/.glusterfs/3b
> 19M /opt/lvmdir/c2/brick/.glusterfs/3c
> 8.0M /opt/lvmdir/c2/brick/.glusterfs/3d
> 9.3M /opt/lvmdir/c2/brick/.glusterfs/3e
> 9.9M /opt/lvmdir/c2/brick/.glusterfs/3f
> 952K /opt/lvmdir/c2/brick/.glusterfs/40
> 10M /opt/lvmdir/c2/brick/.glusterfs/41
> 17M /opt/lvmdir/c2/brick/.glusterfs/42
> 20M /opt/lvmdir/c2/brick/.glusterfs/43
> 1.7M /opt/lvmdir/c2/brick/.glusterfs/44
> 7.1M /opt/lvmdir/c2/brick/.glusterfs/45
> 29M /opt/lvmdir/c2/brick/.glusterfs/46
> 4.5M /opt/lvmdir/c2/brick/.glusterfs/47
> 17M /opt/lvmdir/c2/brick/.glusterfs/48
> 9.0M /opt/lvmdir/c2/brick/.glusterfs/49
> 4.4M /opt/lvmdir/c2/brick/.glusterfs/4a
> 9.7M /opt/lvmdir/c2/brick/.glusterfs/4b
> 3.1M /opt/lvmdir/c2/brick/.glusterfs/4c
> 1.9M /opt/lvmdir/c2/brick/.glusterfs/4d
> 9.7M /opt/lvmdir/c2/brick/.glusterfs/4e
> 648K /opt/lvmdir/c2/brick/.glusterfs/4f
> 8.0M /opt/lvmdir/c2/brick/.glusterfs/50
> 14M /opt/lvmdir/c2/brick/.glusterfs/51
> 1.9M /opt/lvmdir/c2/brick/.glusterfs/52
> 1.6M /opt/lvmdir/c2/brick/.glusterfs/53
> 4.4M /opt/lvmdir/c2/brick/.glusterfs/54
> 3.3M /opt/lvmdir/c2/brick/.glusterfs/55
> 6.1M /opt/lvmdir/c2/brick/.glusterfs/56
> 18M /opt/lvmdir/c2/brick/.glusterfs/57
> 2.8M /opt/lvmdir/c2/brick/.glusterfs/58
> 6.5M /opt/lvmdir/c2/brick/.glusterfs/59
> 2.2M /opt/lvmdir/c2/brick/.glusterfs/5a
> 380K /opt/lvmdir/c2/brick/.glusterfs/5b
> 12M /opt/lvmdir/c2/brick/.glusterfs/5c
> 2.4M /opt/lvmdir/c2/brick/.glusterfs/5d
> 22M /opt/lvmdir/c2/brick/.glusterfs/5e
> 5.6M /opt/lvmdir/c2/brick/.glusterfs/5f
> 15M /opt/lvmdir/c2/brick/.glusterfs/60
> 15M /opt/lvmdir/c2/brick/.glusterfs/61
> 9.3M /opt/lvmdir/c2/brick/.glusterfs/62
> 1.1M /opt/lvmdir/c2/brick/.glusterfs/63
> 57M /opt/lvmdir/c2/brick/.glusterfs/64
> 7.5M /opt/lvmdir/c2/brick/.glusterfs/65
> 18M /opt/lvmdir/c2/brick/.glusterfs/66
> 4.6M /opt/lvmdir/c2/brick/.glusterfs/67
> 1.1M /opt/lvmdir/c2/brick/.glusterfs/68
> 9.3M /opt/lvmdir/c2/brick/.glusterfs/69
> 12M /opt/lvmdir/c2/brick/.glusterfs/6a
> 18M /opt/lvmdir/c2/brick/.glusterfs/6b
> 8.5M /opt/lvmdir/c2/brick/.glusterfs/6c
> 1.7M /opt/lvmdir/c2/brick/.glusterfs/6d
> 7.8M /opt/lvmdir/c2/brick/.glusterfs/6e
> 5.4M /opt/lvmdir/c2/brick/.glusterfs/6f
> 13M /opt/lvmdir/c2/brick/.glusterfs/70
> 3.7M /opt/lvmdir/c2/brick/.glusterfs/71
> 6.4M /opt/lvmdir/c2/brick/.glusterfs/72
> 596K /opt/lvmdir/c2/brick/.glusterfs/73
> 13M /opt/lvmdir/c2/brick/.glusterfs/74
> 10M /opt/lvmdir/c2/brick/.glusterfs/75
> 6.0M /opt/lvmdir/c2/brick/.glusterfs/76
> 448K /opt/lvmdir/c2/brick/.glusterfs/77
> 102M /opt/lvmdir/c2/brick/.glusterfs/78
> 3.3M /opt/lvmdir/c2/brick/.glusterfs/79
> 4.5M /opt/lvmdir/c2/brick/.glusterfs/7a
> 5.2M /opt/lvmdir/c2/brick/.glusterfs/7b
> 3.0M /opt/lvmdir/c2/brick/.glusterfs/7c
> 6.7M /opt/lvmdir/c2/brick/.glusterfs/7d
> 8.0M /opt/lvmdir/c2/brick/.glusterfs/7e
> 10M /opt/lvmdir/c2/brick/.glusterfs/7f
> 7.4M /opt/lvmdir/c2/brick/.glusterfs/80
> 7.0M /opt/lvmdir/c2/brick/.glusterfs/81
> 4.3M /opt/lvmdir/c2/brick/.glusterfs/82
> 5.7M /opt/lvmdir/c2/brick/.glusterfs/83
> 12M /opt/lvmdir/c2/brick/.glusterfs/84
> 4.9M /opt/lvmdir/c2/brick/.glusterfs/85
> 7.9M /opt/lvmdir/c2/brick/.glusterfs/86
> 14M /opt/lvmdir/c2/brick/.glusterfs/87
> 7.7M /opt/lvmdir/c2/brick/.glusterfs/88
> 55M /opt/lvmdir/c2/brick/.glusterfs/89
> 19M /opt/lvmdir/c2/brick/.glusterfs/8a
> 7.4M /opt/lvmdir/c2/brick/.glusterfs/8b
> 26M /opt/lvmdir/c2/brick/.glusterfs/8c
> 2.0M /opt/lvmdir/c2/brick/.glusterfs/8d
> 5.4M /opt/lvmdir/c2/brick/.glusterfs/8e
> 13M /opt/lvmdir/c2/brick/.glusterfs/8f
> 3.6M /opt/lvmdir/c2/brick/.glusterfs/90
> 60M /opt/lvmdir/c2/brick/.glusterfs/91
> 16M /opt/lvmdir/c2/brick/.glusterfs/92
> 30M /opt/lvmdir/c2/brick/.glusterfs/93
> 2.6M /opt/lvmdir/c2/brick/.glusterfs/94
> 52M /opt/lvmdir/c2/brick/.glusterfs/95
> 4.9M /opt/lvmdir/c2/brick/.glusterfs/96
> 1.7M /opt/lvmdir/c2/brick/.glusterfs/97
> 9.2M /opt/lvmdir/c2/brick/.glusterfs/98
> 6.2M /opt/lvmdir/c2/brick/.glusterfs/99
> 5.5M /opt/lvmdir/c2/brick/.glusterfs/9a
> 4.2M /opt/lvmdir/c2/brick/.glusterfs/9b
> 47M /opt/lvmdir/c2/brick/.glusterfs/9c
> 2.2M /opt/lvmdir/c2/brick/.glusterfs/9d
> 32M /opt/lvmdir/c2/brick/.glusterfs/9e
> 13M /opt/lvmdir/c2/brick/.glusterfs/9f
> 11M /opt/lvmdir/c2/brick/.glusterfs/a0
> 5.6M /opt/lvmdir/c2/brick/.glusterfs/a1
> 17M /opt/lvmdir/c2/brick/.glusterfs/a2
> 3.3M /opt/lvmdir/c2/brick/.glusterfs/a3
> 18M /opt/lvmdir/c2/brick/.glusterfs/a4
> 21M /opt/lvmdir/c2/brick/.glusterfs/a5
> 13M /opt/lvmdir/c2/brick/.glusterfs/a6
> 18M /opt/lvmdir/c2/brick/.glusterfs/a7
> 5.5M /opt/lvmdir/c2/brick/.glusterfs/a8
> 4.5M /opt/lvmdir/c2/brick/.glusterfs/a9
> 4.4M /opt/lvmdir/c2/brick/.glusterfs/aa
> 21M /opt/lvmdir/c2/brick/.glusterfs/ab
> 3.7M /opt/lvmdir/c2/brick/.glusterfs/ac
> 13M /opt/lvmdir/c2/brick/.glusterfs/ad
> 1.7M /opt/lvmdir/c2/brick/.glusterfs/ae
> 9.1M /opt/lvmdir/c2/brick/.glusterfs/af
> 50M /opt/lvmdir/c2/brick/.glusterfs/b0
> 3.9M /opt/lvmdir/c2/brick/.glusterfs/b1
> 8.8M /opt/lvmdir/c2/brick/.glusterfs/b2
> 64M /opt/lvmdir/c2/brick/.glusterfs/b3
> 13M /opt/lvmdir/c2/brick/.glusterfs/b4
> 7.7M /opt/lvmdir/c2/brick/.glusterfs/b5
> 3.0M /opt/lvmdir/c2/brick/.glusterfs/b6
> 7.8M /opt/lvmdir/c2/brick/.glusterfs/b7
> 2.8M /opt/lvmdir/c2/brick/.glusterfs/b8
> 11M /opt/lvmdir/c2/brick/.glusterfs/b9
> 4.6M /opt/lvmdir/c2/brick/.glusterfs/ba
> 40M /opt/lvmdir/c2/brick/.glusterfs/bb
> 17M /opt/lvmdir/c2/brick/.glusterfs/bc
> 716K /opt/lvmdir/c2/brick/.glusterfs/bd
> 2.2M /opt/lvmdir/c2/brick/.glusterfs/be
> 14M /opt/lvmdir/c2/brick/.glusterfs/bf
> 3.2M /opt/lvmdir/c2/brick/.glusterfs/c0
> 11M /opt/lvmdir/c2/brick/.glusterfs/c1
> 18M /opt/lvmdir/c2/brick/.glusterfs/c2
> 8.7M /opt/lvmdir/c2/brick/.glusterfs/c3
> 1.1M /opt/lvmdir/c2/brick/.glusterfs/c4
> 4.3M /opt/lvmdir/c2/brick/.glusterfs/c5
> 5.0M /opt/lvmdir/c2/brick/.glusterfs/c6
> 44M /opt/lvmdir/c2/brick/.glusterfs/c7
> 1.0M /opt/lvmdir/c2/brick/.glusterfs/c8
> 4.5M /opt/lvmdir/c2/brick/.glusterfs/c9
> 2.9M /opt/lvmdir/c2/brick/.glusterfs/ca
> 8.4M /opt/lvmdir/c2/brick/.glusterfs/cb
> 3.1M /opt/lvmdir/c2/brick/.glusterfs/cc
> 14M /opt/lvmdir/c2/brick/.glusterfs/cd
> 15M /opt/lvmdir/c2/brick/.glusterfs/ce
> 4.7M /opt/lvmdir/c2/brick/.glusterfs/cf
> 12K /opt/lvmdir/c2/brick/.glusterfs/changelogs
> 36M /opt/lvmdir/c2/brick/.glusterfs/d0
> 8.8M /opt/lvmdir/c2/brick/.glusterfs/d1
> 6.8M /opt/lvmdir/c2/brick/.glusterfs/d2
> 4.4M /opt/lvmdir/c2/brick/.glusterfs/d3
> 2.3M /opt/lvmdir/c2/brick/.glusterfs/d4
> 1.1M /opt/lvmdir/c2/brick/.glusterfs/d5
> 16M /opt/lvmdir/c2/brick/.glusterfs/d6
> 48M /opt/lvmdir/c2/brick/.glusterfs/d7
> 6.8M /opt/lvmdir/c2/brick/.glusterfs/d8
> 20M /opt/lvmdir/c2/brick/.glusterfs/d9
> 5.7M /opt/lvmdir/c2/brick/.glusterfs/da
> 3.9M /opt/lvmdir/c2/brick/.glusterfs/db
> 788K /opt/lvmdir/c2/brick/.glusterfs/dc
> 3.1M /opt/lvmdir/c2/brick/.glusterfs/dd
> 3.5M /opt/lvmdir/c2/brick/.glusterfs/de
> 45M /opt/lvmdir/c2/brick/.glusterfs/df
> 5.2M /opt/lvmdir/c2/brick/.glusterfs/e0
> 4.2M /opt/lvmdir/c2/brick/.glusterfs/e1
> 9.2M /opt/lvmdir/c2/brick/.glusterfs/e2
> 2.4M /opt/lvmdir/c2/brick/.glusterfs/e3
> 11M /opt/lvmdir/c2/brick/.glusterfs/e4
> 61M /opt/lvmdir/c2/brick/.glusterfs/e5
> 12M /opt/lvmdir/c2/brick/.glusterfs/e6
> 1.1M /opt/lvmdir/c2/brick/.glusterfs/e7
> 5.9M /opt/lvmdir/c2/brick/.glusterfs/e8
> 5.3M /opt/lvmdir/c2/brick/.glusterfs/e9
> 1.6M /opt/lvmdir/c2/brick/.glusterfs/ea
> 968K /opt/lvmdir/c2/brick/.glusterfs/eb
> 9.5M /opt/lvmdir/c2/brick/.glusterfs/ec
> 13M /opt/lvmdir/c2/brick/.glusterfs/ed
> 15M /opt/lvmdir/c2/brick/.glusterfs/ee
> 13M /opt/lvmdir/c2/brick/.glusterfs/ef
> 4.1M /opt/lvmdir/c2/brick/.glusterfs/f0
> 13M /opt/lvmdir/c2/brick/.glusterfs/f1
> 32M /opt/lvmdir/c2/brick/.glusterfs/f2
> 5.8M /opt/lvmdir/c2/brick/.glusterfs/f3
> 5.2M /opt/lvmdir/c2/brick/.glusterfs/f4
> 5.9M /opt/lvmdir/c2/brick/.glusterfs/f5
> 14M /opt/lvmdir/c2/brick/.glusterfs/f6
> 2.3M /opt/lvmdir/c2/brick/.glusterfs/f7
> 2.5M /opt/lvmdir/c2/brick/.glusterfs/f8
> 12M /opt/lvmdir/c2/brick/.glusterfs/f9
> 432K /opt/lvmdir/c2/brick/.glusterfs/fa
> 15M /opt/lvmdir/c2/brick/.glusterfs/fb
> 37M /opt/lvmdir/c2/brick/.glusterfs/fc
> 3.1M /opt/lvmdir/c2/brick/.glusterfs/fd
> 1.9M /opt/lvmdir/c2/brick/.glusterfs/fe
> 4.1M /opt/lvmdir/c2/brick/.glusterfs/ff
> 4.0K /opt/lvmdir/c2/brick/.glusterfs/health_check
> 8.0K /opt/lvmdir/c2/brick/.glusterfs/indices
> 4.0K /opt/lvmdir/c2/brick/.glusterfs/landfill
> #
>
> In which it is clear that all the backup/metadata files created w.r.t
> original files in gluster mount point taking to much spaces.
>
> Please let us know the reason of this problem.
> --
>
> Regards
> Abhishek Paliwal
>
--
Regards
Abhishek Paliwal
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-devel/attachments/20170407/d8b111b7/attachment-0001.html>
More information about the Gluster-devel
mailing list