[Gluster-devel] GlusterFs: Problems with Memory Mapped Files and "apt-get" on debian

[Urban Loesch]

Ups sorry, forgot to send the answer to the hole list!
Here comes the answer.

...

Hi Avati,

the fuse version is:

drbdtest03:~# dmesg |grep fuse
fuse init (API version 7.7)

on all of the three testservers.
The installed packages are:

drbdtest03:~# dpkg -l |grep fuse
ii  fuse-utils                              
2.6.3-2                         Filesystem in USErspace (utilities)
ii  libfuse-dev                             
2.6.3-2                         Filesystem in USErspace (development files)
ii  libfuse2                                
2.6.3-2                         Filesystem in USErspace library

thanks,
Urban


Anand Avati wrote:
> Urban,
>  can you please mention the fuse version (kernel-fuse and libfuse
> both)? you can find with "dmesg|grep fuse" and output something like
> ---
> fuse init (API version 7.8)
> fuse distribution version: 2.6.0
> ---
>
> thanks,
> avati
>
> 2007/5/21, Urban Loesch <ul at enas.net>:
>> Hi Avati,
>>
>> thanks. I tried out the latest 2.4 tla. But there is still the same 
>> error.
>>
>> mastersql:/# apt-get update
>> Get:1 http://security.debian.org etch/updates Release.gpg [189B]
>> Get:2 http://security.debian.org etch/updates Release [22.5kB]
>> Ign http://security.debian.org etch/updates/main Packages/DiffIndex
>> Ign http://security.debian.org etch/updates/contrib Packages/DiffIndex
>> Ign http://security.debian.org etch/updates/non-free Packages/DiffIndex
>> Get:3 http://security.debian.org etch/updates/main Packages [71.6kB]
>> Hit http://security.debian.org etch/updates/contrib Packages
>> Hit http://security.debian.org etch/updates/non-free
>> Packages
>> Get:4 http://ftp.de.debian.org etch Release.gpg
>> [378B]
>>
>> Hit http://ftp.de.debian.org etch
>> Release
>>
>> Ign http://ftp.de.debian.org etch/main
>> Packages/DiffIndex
>>
>> Ign http://ftp.de.debian.org etch/contrib
>> Packages/DiffIndex
>>
>> Ign http://ftp.de.debian.org etch/non-free
>> Packages/DiffIndex
>>
>> Hit http://ftp.de.debian.org etch/main
>> Packages
>>
>> Hit http://ftp.de.debian.org etch/contrib
>> Packages
>>
>> Hit http://ftp.de.debian.org etch/non-free
>> Packages
>>
>> Fetched 94.2kB in 9s
>> (9525B/s)
>>
>> Reading package lists... Error!
>> E: Couldn't make mmap of 12582912 bytes - mmap (19 No such device)
>> W: Unable to munmap
>> E: The package lists or status file could not be parsed or opened.
>> mastersql:/# apt-cache search
>> E: Couldn't make mmap of 12582912 bytes - mmap (19 No such device)
>> W: Unable to munmap
>>
>> I made an strace of apt-get. The result you can find on the links below.
>> Hope that will help.
>>
>> http://www.enas.net/glusterfs/apt-get-update.txt
>> http://www.enas.net/glusterfs/apt-cache.txt
>>
>> Thanks
>> Urban
>>
>>
>>
>>
>> Anand Avati wrote:
>> > Urban,
>> >  I've made some changes related to the way  mmap files are handled,
>> > can you please check with the latest TLA (glusterfs--mainline--2.4)
>> >
>> > thanks
>> > avati
>> >
>> > 2007/5/15, Urban Loesch <ul at enas.net>:
>> >> Hi,
>> >>
>> >> I have a problem with "mmap" on my GlusterFs test environment and 
>> "apt"
>> >> on Debian.
>> >>
>> >> My environment:
>> >> Hardware:
>> >> 2 different servers for storage
>> >> 1 server as client
>> >> On top of the server I use a virtual server setup (details
>> >> http://linux-vserver.org).
>> >>
>> >> OS:
>> >> Debian Sarge with self compiled 2.6.19.2 (uname -r 
>> 2.6.19.2-vs2.2.0) and
>> >> latest stable virtual server patch.
>> >> GlusterFs: latest mainline 2.4 from repository
>> >>
>> >> What I'm trying to do:
>> >> - Create a AFR Mirror over the 2 Servers.
>> >> - Mount the Volume on Server 3 (Client).
>> >> - Install on the mounted volume the hole virtual Server with Apache,
>> >> MySql and so on.
>> >> So I have a full redundant Virtual Server mirrored over two bricks .
>> >>
>> >> After some help from Avati Anand last week the above setup works just
>> >> fine. I tried out Mysql and it works normally (will make some more 
>> tests
>> >> in the future).
>> >>
>> >> But now I have the problem with apt.
>> >> For example when I try to update the packagelists within the virtual
>> >> server I get the following error:
>> >> mastersql:/# apt-get update
>> >> Get:1 http://security.debian.org etch/updates Release.gpg
>> >> [189B]
>> >> ...                                                       Hit
>> >> http://ftp.de.debian.org etch/non-free
>> >> Packages
>> >>
>> >>
>> >> Fetched 2B in 7s
>> >> (0B/s)
>> >>
>> >> Reading package lists... Error!
>> >> E: Couldn't make mmap of 12582912 bytes - mmap (19 No such device)
>> >> W: Unable to munmap
>> >> E: The package lists or status file could not be parsed or opened.
>> >>
>> >> After some googling I found out, that apt uses "memory mapped 
>> files" and
>> >> it seems that apt can't find some device.
>> >> But I'm not able to find out which device does it can't find.
>> >>
>> >> Short description of MMAP:
>> >> http://www.ecst.csuchico.edu/~beej/guide/ipc/mmap.html
>> >>
>> >> Have you any idea what can cause this problem? Without GlusterFs 
>> as the
>> >> underlaying filesystem the problems not occurs.
>> >>
>> >> thanks
>> >> Urban Loesch
>> >>
>> >>
>> >> _______________________________________________
>> >> Gluster-devel mailing list
>> >> Gluster-devel at nongnu.org
>> >> http://lists.nongnu.org/mailman/listinfo/gluster-devel
>> >>
>> >
>> >
>>
>>
>
>