[Gluster-users] Gluster not recognizing available space

Pat Haley phaley at MIT.EDU
Tue Feb 4 17:46:09 UTC 2014


I tried to "go behind" gluster and directly
write a file to the nfs filesystem on gluster-0-1.

If I try to write to /mseas-data-0-1 (the file
space served by gluster-0-1) directly I still
get the "No space left on device" error.
(df -h still shows 784G on that disk)

If I try to write to the system disk
(the only other area) there is no problem.

I don't have any portion of the disk served by
gluster-0-1 that is not under gluster, so I
can't try to write to a non-gluster portion of
the disk.

Does this suggest anything?


> Hi Jeffrey,
> Two simple questions (reflecting my ignorance):
> Where do I find these trusted.gluster.fs.dht files?
> (or if they aren't files, how do I find the information
> you're reqesting?)
> If it is glusterfsd starting before the local filesystems
> are mounted, would a service glusterd restart have
> reset this?
> Thanks
> Pat
>>> rebooting gluster-0-1 did not solve the problem.  The one
>>> change I did notice is that now the only place I can write
>>> is to one of the test directories I had previously created
>>> which had not appeared on gluster-0-1.  Now, trying to create
>>> a new directory elsewhere results in the "No space left on device"
>>> error.
>> It would be very interesting to look at the trusted.glusterfs.dht
>> xattrs on (the various copies of) that directory, especially as
>> compared to the same on some other directory where you *do* get
>> the ENOSPC error.  It does sound like we think that one brick is
>> full, even though there's no particular reason we should.  Maybe
>> misinterpreting some other error?  Using a different filesystem
>> "under" the one that's currently mounted there, and that one
>> really *is* full?  That could happen if glusterfsd is starting
>> before local filesystems are all mounted, for example.


Pat Haley                          Email:  phaley at mit.edu
Center for Ocean Engineering       Phone:  (617) 253-6824
Dept. of Mechanical Engineering    Fax:    (617) 253-8125
MIT, Room 5-213                    http://web.mit.edu/phaley/www/
77 Massachusetts Avenue
Cambridge, MA  02139-4301

More information about the Gluster-users mailing list