[Gluster-devel] [Gluster-users] Status of the SAMBA module
haiwei.xie-soulinfo
haiwei.xie at soulinfo.com
Tue Aug 6 11:39:10 UTC 2013
Hi,
Unfortunately, add the two params into smb.conf, nfs client OS will core dump with dd testing.
I reconfigure gluster vol, without any new params in smb.conf, performance looks good. Maybe
former low performance result from error config.
[root at infi131 cifs]# dd if=/dev/zero of=t1 bs=64k count=100000
记录了100000+0 的读入
记录了100000+0 的写出
6553600000字节(6.6 GB)已复制，21.3123 秒，308 MB/秒
bugs:
1, dd bs > 128K, glusterfs brick log shows client disconnect, I guess api caller crash.
in /var/log/samba/cores, may core files.
2, some times, nfs client OS core dump.
crash kernel log like:
Aug 6 11:06:36 infi131 kernel: INFO: task dd:3146 blocked for more than 120 seconds.
Aug 6 11:06:36 infi131 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug 6 11:06:36 infi131 kernel: dd D 0000000000000000 0 3146 2754 0x00000084
Aug 6 11:06:36 infi131 kernel: ffff880125b55cd8 0000000000000082 0000000000000000 fff880123fc0<>ff802b5f ffff065fff802117 ff813fc3<>ff803c4f ff8155f8000000f8 ff819b58<>alTae
Aug 6 11:10:36 infi131 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug 6 11:10:36 infi131 kernel: dd D 0000000000000000 0 3146 2754 0x00000084
Aug 6 11:10:36 infi131 kernel: ffff880125b55cd8 0000000000000082 0000000000000000 ffff8801231f1c10
Aug 6 11:10:36 infi131 kernel: ffff880125b55cf8 ffffffffa046c50f ffff8801231f1c72 ffff8801231f1c73
Aug 6 11:10:36 infi131 kernel: ffff880139cb45f8 ffff880125b55fd8 000000000000fb88 ffff880139cb45f8
Aug 6 11:10:36 infi131 kernel: Call Trace:
Aug 6 11:10:36 infi131 kernel: [<ffffffffa046c50f>]? ciswieae+x2/x8 cf]<>[ffff819d> ycpg+x/x0<>[ffff85d7> oshdl+x30c
Aug 6 11:14:21 infi131 kernel: ipmi device interface
Any advise? thx.
terrs.
> Hi,
>
> 1. Please add in global section in smb.conf the following lines:
>
> kernel oplocks = no
> stat cache = no
>
> 2. service smb restart
>
> Please try the same test and let us know if that helps to increase the
> throughput.
>
>
> Raghavendra Talur
>
>
>
>
>
>
> On Tue, Aug 6, 2013 at 1:00 PM, haiwei.xie-soulinfo <haiwei.xie at soulinfo.com
> > wrote:
>
> > hi, All
> >
> > samba vfs low performance, compare with non-vfs export dir.
> >
> > nonvfs:
> > [root at infi131 cifs]# dd if=/dev/zero of=test1 bs=64k
> > ^C记录了55548+1 的读入
> > 记录了55548+0 的写出
> > 3640393728字节(3.6 GB)已复制，17.192 秒，212 MB/秒
> >
> > vfs:
> > [root at infi131 cifs]# cd /mnt/cifs
> > [root at infi131 cifs]# dd if=/dev/zero of=test1 bs=64k count=10000
> > 记录了10000+0 的读入
> > 记录了10000+0 的写出
> > 655360000字节(655 MB)已复制，7.11406 秒，92.1 MB/秒
> >
> >
> > Any advise? Thanks
> >
> > terrs.
> >
> >
> > >
> > > hi, my testing:
> > >
> > > # glusterd -V
> > > glusterfs 3.4.0 built on Jul 25 2013 04:12:26
> > >
> > > # smbd -V
> > > Version 3.6.9-151.el6
> > >
> > > samba-gluster-vfs:
> > > git://forge.gluster.org/samba-glusterfs/samba-glusterfs-vfs.git
> > >
> > > smb.conf:
> > > [gvol]
> > > comment = For samba export of volume test
> > > vfs objects = glusterfs
> > > glusterfs:volfile_server = localhost
> > > glusterfs:volume = two
> > > path = /
> > > read only = no
> > > guest ok = yes
> > >
> > >
> > > On linux client, but dd testing will be pending.
> > >
> > > dd if=/dev/zero of=data bs=64k count=10000, successfully.
> > > dd if=/dev/zero of=data bs=128k count=10000, pending.
> > >
> > > Samba4.1 needed? Thanks.
> > >
> > > -terrs
> > >
> > >
> > > On Mon, 29 Jul 2013 02:10:10 -0700
> > > Anand Avati <anand.avati at gmail.com> wrote:
> > >
> > > > On Mon, Jul 29, 2013 at 1:56 AM, Nux! <nux at li.nux.ro> wrote:
> > > >
> > > > > On 29.07.2013 07:16, Daniel Müller wrote:
> > > > >
> > > > >> But you need to have gluster installed!? Which version?
> > > > >> Samba4.1 does not compile with the lates glusterfs 3.4 on CentOs
> > 6.4.
> > > > >>
> > > > >
> > > > > From what JM said, it builds against EL6 Samba (3.6) and it has also
> > been
> > > > > added to upstream.
> > > >
> > > >
> > > > You will need the latest Samba 4.1 release (or git HEAD),and
> > > > glusterfs-api-devel RPM (with its deps) installed at the time of
> > building
> > > > Samba to get the vfs module built.
> > > >
> > > > Avati
> > >
> > > _______________________________________________
> > > Gluster-users mailing list
> > > Gluster-users at gluster.org
> > > http://supercolony.gluster.org/mailman/listinfo/gluster-users
> >
> > --
> > 谢海威
> > 软件项目经理
> > 电话: +86 10-68920588
> > 手机: +86 13911703586
> > Email: haiwei.xie at soulinfo.com
> > _______________________________________________
> > Gluster-users mailing list
> > Gluster-users at gluster.org
> > http://supercolony.gluster.org/mailman/listinfo/gluster-users
> >
>
>
>
> --
> *Raghavendra Talur *
--
谢海威
软件项目经理
电话: +86 10-68920588
手机: +86 13911703586
Email: haiwei.xie at soulinfo.com
More information about the Gluster-devel
mailing list