[Gluster-users] Revisit: FORTRAN Codes and File I/O

[Brian Smith]

It's obviously been a while since I brought this issue up, but it has
cropped up again for us.  We're now on 3.0.3 and I've included my
glusterfs*.vol files below.  We end up with file i/o errors like the
ones below:

forrtl: File exists
forrtl: severe (10): cannot overwrite existing file, unit 18,
file /work/b/brs/vdWSi/CHGCAR

Even if the file existed, it shouldn't really be a problem.  Other file
systems work just fine.  I'll get some more verbose logging going and
share my output.  glusterfsd.vol is the same in the referenced e-mails
below.

Thanks in advance,
-Brian


## file auto generated by /usr/bin/glusterfs-volgen (mount.vol)
# Cmd line:
# $ /usr/bin/glusterfs-volgen --name work pvfs0:/pvfs/glusterfs
pvfs1:/pvfs/glusterfs

# TRANSPORT-TYPE tcp
volume pvfs0-1
    type protocol/client
    option transport-type tcp
    option remote-host pvfs0
    option remote-port 6996
    option transport.socket.nodelay on
    option remote-subvolume brick1
end-volume

volume pvfs1-1
    type protocol/client
    option transport-type tcp
    option remote-host pvfs1
    option remote-port 6996
    option transport.socket.nodelay on
    option remote-subvolume brick1
end-volume

volume distribute
    type cluster/distribute
    subvolumes pvfs0-1 pvfs1-1
end-volume

volume writebehind
    type performance/write-behind
    option cache-size 4MB
    subvolumes distribute
end-volume

volume readahead
    type performance/read-ahead
    option page-count 4
    subvolumes writebehind
end-volume

#volume iocache
#    type performance/io-cache
#    option cache-size 1GB
#    option cache-timeout 1
#    subvolumes readahead
#end-volume

#volume quickread
#    type performance/quick-read
#    option cache-timeout 1
#    option max-file-size 64kB
#    subvolumes iocache
#end-volume

#volume statprefetch
#    type performance/stat-prefetch
#    subvolumes quickread
#end-volume


==========================





* replies inline *
On Fri, Feb 12, 2010 at 9:52 PM, Brian Smith <brs at usf.edu> wrote:

> Hi, Harshavardhana,
>
> Thanks for the reply.  My volume files are below.  Unfortunately,
there
> is no helpful information in the logs as it seems the log verbosity is
> set too low.  I'll update that and hopefully get some more
information.
> I'm using distribute and not NUFA.
>
>
Perfect.

> ## file auto generated by /usr/bin/glusterfs-volgen (export.vol)
> # Cmd line:
> # $ /usr/bin/glusterfs-volgen --name work pvfs0:/pvfs/glusterfs
> pvfs1:/pvfs/glusterfs
>
> volume posix1
>  type storage/posix
>  option directory /pvfs/glusterfs
> end-volume
>
> volume locks1
>    type features/locks
>    subvolumes posix1
>    option mandatory-locks on
> end-volume
>
> volume brick1
>    type performance/io-threads
>    option thread-count 8
>    subvolumes locks1
> end-volume
>
> volume server-tcp
>    type protocol/server
>    option transport-type tcp
>    option auth.addr.brick1.allow *
>    option transport.socket.listen-port 6996
>    option transport.socket.nodelay on
>    subvolumes brick1
> end-volume
>
> ## file auto generated by /usr/bin/glusterfs-volgen (mount.vol)
> # Cmd line:
> # $ /usr/bin/glusterfs-volgen --name work pvfs0:/pvfs/glusterfs
> pvfs1:/pvfs/glusterfs
>
> # TRANSPORT-TYPE tcp
> volume pvfs0-1
>    type protocol/client
>    option transport-type tcp
>    option remote-host pvfs0
>    option transport.socket.nodelay on
>    option transport.remote-port 6996
>    option remote-subvolume brick1
> end-volume
>
> volume pvfs1-1
>    type protocol/client
>    option transport-type tcp
>    option remote-host pvfs1
>    option transport.socket.nodelay on
>    option transport.remote-port 6996
>    option remote-subvolume brick1
> end-volume
>
> volume distribute
>    type cluster/distribute
>    subvolumes pvfs0-1 pvfs1-1
> end-volume
>
> volume writebehind
>    type performance/write-behind
>    option cache-size 4MB
>    subvolumes distribute
> end-volume
>
> volume readahead
>    type performance/read-ahead
>    option page-count 4
>    subvolumes writebehind
> end-volume
>
> volume iocache
>    type performance/io-cache
>    option cache-size 1GB
>    option cache-timeout 1
>    subvolumes readahead
> end-volume
>
> volume quickread
>    type performance/quick-read
>    option cache-timeout 1
>    option max-file-size 64kB
>    subvolumes iocache
> end-volume
>
> volume statprefetch
>    type performance/stat-prefetch
>    subvolumes quickread
> end-volume
>
>
> Could you remove the above "quickread", stat-prefetch, io-cache and
test
again. Also could you state the version you are using?.



> --
> Brian Smith
> Senior Systems Administrator
> IT Research Computing, University of South Florida
> 4202 E. Fowler Ave. ENB204
> Office Phone: +1 813 974-1467
> Organization URL: http://rc.usf.edu
>
>