[Gluster-users] No space left on device

zander at ekp.uni-karlsruhe.de zander at ekp.uni-karlsruhe.de
Tue Jan 18 20:01:41 UTC 2011

Dear all,

today, we started using GlusterFS at our institute at a large scale. A 
problem occurred for the first migrated users, that was already 
discussed on this mailing list, but with an older version of glusterFS 
and, as far as I could tell, without a solution.

When users wants to create or move a file, they sometimes get the error 

mv: cannot create regular file `/storage/cluster/<etc...>': No space 
left on device

Doing df -h tells me, however:

                      104T   69T   36T  66% /storage/cluster

It may be of importance that one brick in the cluster is actually 100% 
used. Others are almost completely empty. I am using GlusterFS.3.1.1, 
the file servers are running debian lenny or ubuntu server 10.04, 
clients are SLC4, SLC5, CentOS and ubuntu server 10.04.

The migration of the users was done in the following way:

The following volume was created:

Volume Name: lemmy
Type: Distribute
Status: Started
Number of Bricks: 5
Transport-type: tcp

The user directories were moved into one of the above folders 
(whichever required the least amount of network traffic), using "find 
-print" a file list was created and an "ls" was done on each line. All 
the data can be read by the users, and for the most part, they can also 
write to their directories. Not always, however, as described above.

Any advice is very much appreciated,
Best Regards,

More information about the Gluster-users mailing list