[Gluster-devel] [Gluster-users] Status of the SAMBA module

haiwei.xie-soulinfo haiwei.xie at soulinfo.com
Tue Aug 6 11:39:10 UTC 2013


Hi,

Unfortunately, add the two params into smb.conf, nfs client OS will core dump with dd testing.
I reconfigure gluster vol, without any new params in smb.conf, performance looks good. Maybe 
former low performance result from error config.

[root at infi131 cifs]# dd if=/dev/zero of=t1 bs=64k count=100000
记录了100000+0 的读入
记录了100000+0 的写出
6553600000字节(6.6 GB)已复制,21.3123 秒,308 MB/秒


bugs:
1, dd bs > 128K,  glusterfs brick log shows client disconnect, I guess api caller crash.
in /var/log/samba/cores, may core files.

2, some times, nfs client OS core dump.

crash kernel log like:
Aug  6 11:06:36 infi131 kernel: INFO: task dd:3146 blocked for more than 120 seconds.
Aug  6 11:06:36 infi131 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug  6 11:06:36 infi131 kernel: dd            D 0000000000000000     0  3146   2754 0x00000084
Aug  6 11:06:36 infi131 kernel: ffff880125b55cd8 0000000000000082 0000000000000000 fff880123fc0<>ff802b5f ffff065fff802117 ff813fc3<>ff803c4f ff8155f8000000f8 ff819b58<>alTae
Aug  6 11:10:36 infi131 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug  6 11:10:36 infi131 kernel: dd            D 0000000000000000     0  3146   2754 0x00000084
Aug  6 11:10:36 infi131 kernel: ffff880125b55cd8 0000000000000082 0000000000000000 ffff8801231f1c10
Aug  6 11:10:36 infi131 kernel: ffff880125b55cf8 ffffffffa046c50f ffff8801231f1c72 ffff8801231f1c73
Aug  6 11:10:36 infi131 kernel: ffff880139cb45f8 ffff880125b55fd8 000000000000fb88 ffff880139cb45f8
Aug  6 11:10:36 infi131 kernel: Call Trace:
Aug  6 11:10:36 infi131 kernel: [<ffffffffa046c50f>]? ciswieae+x2/x8 cf]<>[ffff819d>  ycpg+x/x0<>[ffff85d7> oshdl+x30c
Aug  6 11:14:21 infi131 kernel: ipmi device interface


Any advise? thx.

terrs.


> Hi,
> 
> 1. Please add in global section in smb.conf the following lines:
> 
> kernel oplocks = no
> stat cache      = no
> 
> 2. service smb restart
> 
> Please try the same test and let us know if that helps to increase the
> throughput.
> 
> 
> Raghavendra Talur
> 
> 
> 
> 
> 
> 
> On Tue, Aug 6, 2013 at 1:00 PM, haiwei.xie-soulinfo <haiwei.xie at soulinfo.com
> > wrote:
> 
> > hi, All
> >
> > samba vfs low performance, compare with non-vfs export dir.
> >
> > nonvfs:
> > [root at infi131 cifs]# dd if=/dev/zero of=test1 bs=64k
> > ^C记录了55548+1 的读入
> > 记录了55548+0 的写出
> > 3640393728字节(3.6 GB)已复制,17.192 秒,212 MB/秒
> >
> > vfs:
> > [root at infi131 cifs]# cd /mnt/cifs
> > [root at infi131 cifs]# dd if=/dev/zero of=test1 bs=64k count=10000
> > 记录了10000+0 的读入
> > 记录了10000+0 的写出
> > 655360000字节(655 MB)已复制,7.11406 秒,92.1 MB/秒
> >
> >
> > Any advise? Thanks
> >
> > terrs.
> >
> >
> > >
> > > hi, my testing:
> > >
> > > # glusterd -V
> > > glusterfs 3.4.0 built on Jul 25 2013 04:12:26
> > >
> > > # smbd -V
> > > Version 3.6.9-151.el6
> > >
> > > samba-gluster-vfs:
> > > git://forge.gluster.org/samba-glusterfs/samba-glusterfs-vfs.git
> > >
> > > smb.conf:
> > > [gvol]
> > >         comment = For samba export of volume  test
> > >         vfs objects = glusterfs
> > >         glusterfs:volfile_server = localhost
> > >         glusterfs:volume = two
> > >         path = /
> > >         read only = no
> > >         guest ok = yes
> > >
> > >
> > > On linux client, but dd testing will be pending.
> > >
> > > dd if=/dev/zero of=data bs=64k count=10000, successfully.
> > > dd if=/dev/zero of=data bs=128k count=10000, pending.
> > >
> > > Samba4.1 needed?  Thanks.
> > >
> > > -terrs
> > >
> > >
> > > On Mon, 29 Jul 2013 02:10:10 -0700
> > > Anand Avati <anand.avati at gmail.com> wrote:
> > >
> > > > On Mon, Jul 29, 2013 at 1:56 AM, Nux! <nux at li.nux.ro> wrote:
> > > >
> > > > > On 29.07.2013 07:16, Daniel Müller wrote:
> > > > >
> > > > >> But you need to have gluster installed!? Which version?
> > > > >> Samba4.1 does not compile with the lates glusterfs 3.4 on CentOs
> > 6.4.
> > > > >>
> > > > >
> > > > > From what JM said, it builds against EL6 Samba (3.6) and it has also
> > been
> > > > > added to upstream.
> > > >
> > > >
> > > > You will need the latest Samba 4.1 release (or git HEAD),and
> > > > glusterfs-api-devel RPM (with its deps) installed at the time of
> > building
> > > > Samba to get the vfs module built.
> > > >
> > > > Avati
> > >
> > > _______________________________________________
> > > Gluster-users mailing list
> > > Gluster-users at gluster.org
> > > http://supercolony.gluster.org/mailman/listinfo/gluster-users
> >
> > --
> > 谢海威
> > 软件项目经理
> > 电话:  +86 10-68920588
> > 手机:  +86 13911703586
> > Email:  haiwei.xie at soulinfo.com
> > _______________________________________________
> > Gluster-users mailing list
> > Gluster-users at gluster.org
> > http://supercolony.gluster.org/mailman/listinfo/gluster-users
> >
> 
> 
> 
> -- 
> *Raghavendra Talur *


-- 
谢海威
软件项目经理
电话:  +86 10-68920588
手机:  +86 13911703586
Email:  haiwei.xie at soulinfo.com




More information about the Gluster-devel mailing list