[Gluster-devel] server-side-replication work correct!?

Roland Fischer roland.fischer at xidras.com
Tue Dec 22 15:11:05 UTC 2009


hi,

i have done the parameters what you have wrote to me:

volfile:
cat /etc/glusterfs/export-office-data02-server_repl_gfs-01-02.vol
# export-office-data02-server_repl
# gfs-01-01 /GFS/office-data02
# gfs-01-02 /GFS/office-data02

volume posix
   type storage/posix
   option directory /GFS/office-data02
end-volume

volume locks
   type features/locks
   subvolumes posix
end-volume

volume posix-remote
   type protocol/client
   option transport-type tcp
   option ping-timeout 5
   option remote-host gfs-01-01
   option remote-port 7000
   option remote-subvolume locks
end-volume

volume gfs-replicate
     type cluster/replicate
     subvolumes posix posix-remote
end-volume

volume writebehind
   type performance/write-behind
   option cache-size 2MB
   option flush-behind on
   subvolumes gfs-replicate
end-volume

volume office-data02
   type performance/io-threads
   option thread-count 32 # default is 16
   subvolumes writebehind
end-volume

volume quickread
     type performance/quick-read
     option cache-timeout 1
     option max-file-size 512kB
#    subvolumes web-data
     subvolumes office-data02
end-volume

volume server
   type protocol/server
   option transport-type tcp
   option transport.socket.listen-port 7000
   option auth.addr.office-data02.allow 192.168.11.*
   option auth.addr.locks.allow 192.168.11.*
   subvolumes office-data02 locks
end-volume

log:
[2009-12-22 16:02:27] C [posix.c:4252:posix_entrylk] posix: 
"features/locks" translator is not loaded. You need to use it for proper 
functioning of GlusterFS

i have locks translator in volfile - but where is the failture?

Thank you very much


Am 21.12.2009 20:46, schrieb Raghavendra G:
> Hi Roland,
>
> Please find the Comments inlined
>
> On Fri, Dec 18, 2009 at 3:16 PM, Roland Fischer 
> <roland.fischer at xidras.com <mailto:roland.fischer at xidras.com>> wrote:
>
>     hi all,
>
>     glusterfsversion 3.0.0
>     replication: server-side-replication
>
>     we have 2 glusterfs server with glusterfs v 3.0.0 and one
>     clienthost with glusterfs v3.0.0. Now we have one partition which
>     contains office-files and short videos.
>
>     We simulate a serverfailture on gfs-01-01 (rcnetwork stop; sleep
>     300; rcnetwork start). After rcnetwork stop on gfs-01-01 we see at
>     the client host at mountpoints
>
>     /GFS/office-data02': Transport endpoint is not connected   => we
>     cant do anything on this partition. If gfs-01-01 comes back online
>     the partition is accessable. same situation at gfs-01-02
>     but here if we make a df the clienthost does nothing. if gfs-01-02
>     is back online the partition is again accessable.
>
>     clientlog. (rcnetwork down on gfs-01-01)
>     [2009-12-18 12:06:51] W [fuse-bridge.c:722:fuse_attr_cbk]
>     glusterfs-fuse: 41: STAT() /funny => -1 (Transport endpoint is not
>     connected)
>     [2009-12-18 12:06:55] W [fuse-bridge.c:722:fuse_attr_cbk]
>     glusterfs-fuse: 42: STAT() /funny => -1 (Transport endpoint is not
>     connected)
>     [2009-12-18 12:06:55] W [fuse-bridge.c:2342:fuse_statfs_cbk]
>     glusterfs-fuse: 43: ERR => -1 (Transport endpoint is not connected)
>
>     clientlog: (rcnetwork down on gfs-01-02)
>     [2009-12-18 12:11:48] E
>     [client-protocol.c:415:client_ping_timer_expired]
>     office-data02-rr: Server 192.168.11.82:7000
>     <http://192.168.11.82:7000> has not responded in the last 42
>     seconds, disconnecting.
>     [2009-12-18 12:11:48] E [saved-frames.c:165:saved_frames_unwind]
>     office-data02-rr: forced unwinding frame type(1) op(STAT)
>     [2009-12-18 12:11:48] W [fuse-bridge.c:722:fuse_attr_cbk]
>     glusterfs-fuse: 58: STAT() /funny => -1 (Transport endpoint is not
>     connected)
>     [2009-12-18 12:11:48] E [saved-frames.c:165:saved_frames_unwind]
>     office-data02-rr: forced unwinding frame type(1) op(STATFS)
>     [2009-12-18 12:11:48] W [fuse-bridge.c:2342:fuse_statfs_cbk]
>     glusterfs-fuse: 59: ERR => -1 (Transport endpoint is not connected)
>     [2009-12-18 12:11:48] E [saved-frames.c:165:saved_frames_unwind]
>     office-data02-rr: forced unwinding frame type(2) op(PING)
>     [2009-12-18 12:11:48] N [client-protocol.c:6972:notify]
>     office-data02-rr: disconnected
>     [2009-12-18 12:11:48] N
>     [client-protocol.c:6224:client_setvolume_cbk] office-data02-rr:
>     Connected to 192.168.11.11:7000 <http://192.168.11.11:7000>,
>     attached to remote volume 'office-data02'.
>     [2009-12-18 12:11:48] N
>     [client-protocol.c:6224:client_setvolume_cbk] office-data02-rr:
>     Connected to 192.168.11.11:7000 <http://192.168.11.11:7000>,
>     attached to remote volume 'office-data02'.
>
>
>     Did we do anything wrong? Are the volfile wrong? This couldnt be a
>     normal behavior?
>
>     gfs-01-01:
>     /etc/glusterfs/export-office-data02-server_repl_gfs-01-01.vol
>
>     # export-web-data-server_repl
>     # gfs-01-01 /GFS/web-data
>     # gfs-01-02 /GFS/web-data
>
>     volume posix
>      type storage/posix
>      option directory /GFS/office-data02
>     end-volume
>
>     volume locks
>      type features/locks
>      subvolumes posix
>     end-volume
>
>     volume posix-remote
>      type protocol/client
>      option transport-type tcp
>      option ping-timeout 5
>      option remote-host gfs-01-02
>      option remote-port 7000
>      option remote-subvolume locks
>     end-volume
>
>     volume gfs-replicate
>        type cluster/replicate
>        subvolumes posix-remote
>
>
> subvolumes should be:
>     subvolumes posix-remote posix
>
>
>     end-volume
>
>     volume writebehind
>      type performance/write-behind
>      option cache-size 2MB
>      option flush-behind on
>      subvolumes gfs-replicate
>     end-volume
>
>     volume office-data02
>      type performance/io-threads
>      option thread-count 32 # default is 16
>      subvolumes writebehind
>     end-volume
>
>     volume quickread
>        type performance/quick-read
>        option cache-timeout 1
>        option max-file-size 512kB
>     #    subvolumes web-data
>        subvolumes office-data02
>     end-volume
>
>     volume server
>      type protocol/server
>      option transport-type tcp
>      option transport.socket.listen-port 7000
>      option auth.addr.office-data02.allow 192.xxxx.xxx.*
>      option auth.addr.locks.allow 192.xxxx.xxx.*
>      subvolumes office-data02 locks
>     end-volume
>
>     gfs-01-02:
>     /etc/glusterfs/export-office-data02-server_repl_gfs-01-02.vol
>     # export-office-data02-server_repl
>     # gfs-01-01 /GFS/office-data02
>     # gfs-01-02 /GFS/office-data02
>
>     volume posix
>      type storage/posix
>      option directory /GFS/office-data02
>     end-volume
>
>     volume locks
>      type features/locks
>      subvolumes posix
>     end-volume
>
>     volume posix-remote
>      type protocol/client
>      option transport-type tcp
>      option ping-timeout 5
>      option remote-host gfs-01-01
>      option remote-port 7000
>      option remote-subvolume locks
>     end-volume
>
>     volume gfs-replicate
>        type cluster/replicate
>        subvolumes posix-remote
>
>
> suvolumes should be:
>       subvolumes posix posix-remote
>
> Note that the first entry here is posix, not posix-remote. This order 
> should be maintained as replicate uses the children as lock-servers in 
> the same order as they are given for subvolumes option. Changing the 
> order results in different replicates (server1 and server2) using 
> different lock-servers thereby causing race conditions.
>
>
>     end-volume
>
>     volume writebehind
>      type performance/write-behind
>      option cache-size 2MB
>      option flush-behind on
>      subvolumes gfs-replicate
>     end-volume
>
>     volume office-data02
>      type performance/io-threads
>      option thread-count 32 # default is 16
>      subvolumes writebehind
>     end-volume
>
>     volume quickread
>        type performance/quick-read
>        option cache-timeout 1
>        option max-file-size 512kB
>     #    subvolumes web-data
>        subvolumes office-data02
>     end-volume
>
>     volume server
>      type protocol/server
>      option transport-type tcp
>      option transport.socket.listen-port 7000
>      option auth.addr.office-data02.allow 192.xxx.xxx.*
>      option auth.addr.locks.allow 192.xxx.xxx.*
>      subvolumes office-data02 locks
>     end-volume
>
>     client volfile:
>     volume office-data02-rr
>      type protocol/client
>      option transport-type tcp
>      option remote-host cluster-gfs.xxxx.xxxxx # RRDNS
>      option remote-port 7000
>      option remote-subvolume office-data02
>     end-volume
>
>     volume readahead
>      type performance/read-ahead
>      option page-count 16             # cache per file  = (page-count
>     x page-size)
>      option force-atime-update off # default is off
>      subvolumes office-data02-rr
>     end-volume
>
>     volume writebehind
>      type performance/write-behind
>      option cache-size 512MB # default is equal to aggregate-size
>      option flush-behind on # default is 'off'
>      subvolumes readahead
>     end-volume
>
>     volume iocache
>      type performance/io-cache
>      option cache-size 64MB             # default is 32MB
>     #  option priority *.h:3,*.html:2,*:1 # default is '*:0'
>      option cache-timeout 3             # default is 1 second
>      subvolumes writebehind
>     end-volume
>
>     volume quickread
>      type performance/quick-read
>      option cache-timeout 1
>      option max-file-size 512
>      subvolumes iocache
>     end-volume
>
>     volume stat-prefetch
>      type performance/stat-prefetch
>      subvolumes quickread
>     end-volume
>
>
>     Roland Fischer
>
>
>
>     _______________________________________________
>     Gluster-devel mailing list
>     Gluster-devel at nongnu.org <mailto:Gluster-devel at nongnu.org>
>     http://lists.nongnu.org/mailman/listinfo/gluster-devel
>
>
>
> regards,
> -- 
> Raghavendra G
>

-- 

Roland Fischer
Technik

________________________________________________________________________________

Xidras GmbH
Stockern 47
3744 Stockern
Austria

Tel:     0043 2983 201 30 5 02
Fax:     0043 2983 201 30 5 02 9
Email:   roland.fischer at xidras.com
Web:     http://www.xidras.com

FN 317036 f | Landesgericht Krems | ATU64485024

________________________________________________________________________________

VERTRAULICHE INFORMATIONEN!
Diese eMail enthält vertrauliche Informationen und ist nur für den berechtigten Empfänger bestimmt. Wenn diese eMail nicht für Sie bestimmt ist, bitten wir Sie,diese eMail an uns zurückzusenden und anschließend auf Ihrem Computer und Mail-Server zu löschen. Solche eMails und Anlagen dürfen Sie weder nutzen, noch verarbeiten oder Dritten zugänglich machen, gleich in welcher Form.
Wir danken für Ihre Kooperation!

CONFIDENTIAL!
This email contains confidential information and is intended for the authorised recipient only. If you are not an authorised recipient, please return the email to us and then delete it from your computer and mail-server. You may neither use nor edit any such emails including attachments, nor make them accessible to third parties in any manner whatsoever.
Thank you for your cooperation
________________________________________________________________________________










More information about the Gluster-devel mailing list