[Gluster-users] Files go missing on Gluster

[Gerd W. Naschenweng]

This is highly frustrating and we notice that uploaded images disappear after users upload images.

Background:
Latest version of Gluster running on CentOS 64bit
We have two replicated bricks
The volume is mounted via NFS on our image servers (10.0.0.210:/shared_images /data		nfs 	defaults,_netdev 0 0 / 10.0.0.211:/shared_images /data		nfs 	defaults,_netdev 0 0)
The image servers run CentOS 64bit and use Apache HTTP and Tomcat as the application server
Users upload images via the web and Tomcat writes the file with a unique name to the NFS file-system
We use ImageMagick mogrify to resize the image. This takes a few milliseconds (see log-file entry below)
In certain instances images go missing some time after the upload (the users typically check their uploads and the images seem to disappear hours afterwards)


Gluster configuration:
Type: Replicate
Status: Started
Number of Bricks: 2
Transport-type: tcp
Bricks:
Brick1: 10.0.0.210:/data
Brick2: 10.0.0.211:/data
Options Reconfigured:
performance.cache-size: 1000MB
performance.cache-refresh-timeout: 5
performance.io-cache: on
performance.read-ahead: off
performance.io-thread-count: 16
performance.stat-prefetch: on
performance.write-behind: off
performance.quick-read: on

http://images.bidorbuy.co.za/user_images/974/931974_110412195059_RSA_REDCross.jpg
M/M 12/04/11 19:51:12 ajp-127.0.0.1-8009-2 ImageUploadInterface Optimised Image with : mogrify -resize 500 -quality 75% /home/prodza/webapp/user_images/974/931974_110412195059_RSA_REDCross.jpg
M/M 12/04/11 19:51:12 ajp-127.0.0.1-8009-2 IMAGEUPLOAD:uploadms:12812:compressms:160:uploadbytes:169494:compressbytes:26924:filepath:/home/prodza/webapp/user_images/974/931974_110412195059_RSA_REDCross.jpg
M/M 12/04/11 19:51:12 ajp-127.0.0.1-8009-2 ImageUploadInterface Loaded Image:User:931974:Size:169494:Time:12975:http://images.bidorbuy.co.za/user_images/974/931974_110412195059_RSA_REDCross.jpg

http://images.bidorbuy.co.za/user_images/974/931974_110412223337_VerwoerdFS.jpg
M/M 12/04/11 22:33:53 ajp-127.0.0.1-8009-1 ImageUploadInterface Optimised Image with : mogrify -resize 500 -quality 75% /home/prodza/webapp/user_images/974/931974_110412223337_VerwoerdFS.jpg
M/M 12/04/11 22:33:53 ajp-127.0.0.1-8009-1 IMAGEUPLOAD:uploadms:16245:compressms:320:uploadbytes:218430:compressbytes:168941:filepath:/home/prodza/webapp/user_images/974/931974_110412223337_VerwoerdFS.jpg
M/M 12/04/11 22:33:53 ajp-127.0.0.1-8009-1 ImageUploadInterface Loaded Image:User:931974:Size:218430:Time:16569:http://images.bidorbuy.co.za/user_images/974/931974_110412223337_VerwoerdFS.jpg