[Gluster-users] Unsubscribe
Aladdin Elston
aelston at aerohive.com
Tue Dec 1 23:27:09 UTC 2015
Thank you, Aladdin
On 12/1/15, 4:00 AM, "gluster-users-bounces at gluster.org on behalf of gluster-users-request at gluster.org" <gluster-users-bounces at gluster.org on behalf of gluster-users-request at gluster.org> wrote:
>Send Gluster-users mailing list submissions to
> gluster-users at gluster.org
>
>To subscribe or unsubscribe via the World Wide Web, visit
> http://www.gluster.org/mailman/listinfo/gluster-users
>or, via email, send a message with subject or body 'help' to
> gluster-users-request at gluster.org
>
>You can reach the person managing the list at
> gluster-users-owner at gluster.org
>
>When replying, please edit your Subject line so it is more specific
>than "Re: Contents of Gluster-users digest..."
>
>
>Today's Topics:
>
> 1. REMINDER: Gluster Community Bug Triage meeting (1/12/2015)
> (Manikandan Selvaganesh)
> 2. Re: [Gluster-devel] REMINDER: Gluster Community Bug Triage
> meeting (12/1/2015) (Manikandan Selvaganesh)
> 3. Assistance needed for testing Gluster in the CentOS CI
> infrastructure (Niels de Vos)
> 4. Re: Glusterfs - Translators/Performance
> (Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC])
> 5. Re: Glusterfs - Translators/Performance (Joe Julian)
> 6. unable to mount gluster volume on the client
> (Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC])
> 7. Re: Glusterfs - Translators/Performance
> (Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC])
> 8. Re: Glusterfs - Translators/Performance (Vijay Bellur)
> 9. Re: Glusterfs - Translators/Performance (Vijay Bellur)
> 10. Why oh why does gluster delay? (Andrus, Brian Contractor)
> 11. Split-brain after uploading file (Milo? Koz?k)
> 12. Re: Why oh why does gluster delay? (Atin Mukherjee)
> 13. REMINDER: Gluster Community Bug Triage meeting at 12:00 UTC
> (~in 30 minutes) (Manikandan Selvaganesh)
>
>
>----------------------------------------------------------------------
>
>Message: 1
>Date: Mon, 30 Nov 2015 07:34:50 -0500 (EST)
>From: Manikandan Selvaganesh <mselvaga at redhat.com>
>To: Gluster Devel <gluster-devel at gluster.org>,
> gluster-users at gluster.org
>Subject: [Gluster-users] REMINDER: Gluster Community Bug Triage
> meeting (1/12/2015)
>Message-ID:
> <1163163359.23501490.1448886890681.JavaMail.zimbra at redhat.com>
>Content-Type: text/plain; charset=utf-8
>
>Hi all,
>
>This meeting is scheduled for anyone that is interested in learning more
>about, or assisting with the Bug Triage.
>
>Meeting details:
>- location: #gluster-meeting on Freenode IRC
> ( https://webchat.freenode.net/?channels=gluster-meeting )
>- date: every Tuesday
>- time: 12:00 UTC
> (in your terminal, run: date -d "12:00 UTC")
>- agenda: https://public.pad.fsfe.org/p/gluster-bug-triage
>
>Currently the following items are listed:
>* Roll Call
>* Status of last weeks action items
>* Group Triage
>* Open Floor
>
>The last two topics have space for additions. If you have a suitable bug
>or topic to discuss, please add it to the agenda.
>
>Appreciate your participation.
>
>Thank you :-)
>
>--
>Regards,
>Manikandan Selvaganesh.
>
>
>
>------------------------------
>
>Message: 2
>Date: Mon, 30 Nov 2015 07:37:10 -0500 (EST)
>From: Manikandan Selvaganesh <mselvaga at redhat.com>
>To: Gluster Devel <gluster-devel at gluster.org>,
> gluster-users at gluster.org
>Subject: Re: [Gluster-users] [Gluster-devel] REMINDER: Gluster
> Community Bug Triage meeting (12/1/2015)
>Message-ID:
> <941155429.23502451.1448887030396.JavaMail.zimbra at redhat.com>
>Content-Type: text/plain; charset=utf-8
>
>Sorry, it's 12/1/2015(December 1, 2015).
>
>--
>Regards,
>Manikandan Selvaganesh.
>
>----- Original Message -----
>From: "Manikandan Selvaganesh" <mselvaga at redhat.com>
>To: "Gluster Devel" <gluster-devel at gluster.org>, gluster-users at gluster.org
>Sent: Monday, November 30, 2015 6:04:50 PM
>Subject: [Gluster-devel] REMINDER: Gluster Community Bug Triage meeting (1/12/2015)
>
>Hi all,
>
>This meeting is scheduled for anyone that is interested in learning more
>about, or assisting with the Bug Triage.
>
>Meeting details:
>- location: #gluster-meeting on Freenode IRC
> ( https://webchat.freenode.net/?channels=gluster-meeting )
>- date: every Tuesday
>- time: 12:00 UTC
> (in your terminal, run: date -d "12:00 UTC")
>- agenda: https://public.pad.fsfe.org/p/gluster-bug-triage
>
>Currently the following items are listed:
>* Roll Call
>* Status of last weeks action items
>* Group Triage
>* Open Floor
>
>The last two topics have space for additions. If you have a suitable bug
>or topic to discuss, please add it to the agenda.
>
>Appreciate your participation.
>
>Thank you :-)
>
>--
>Regards,
>Manikandan Selvaganesh.
>
>_______________________________________________
>Gluster-devel mailing list
>Gluster-devel at gluster.org
>http://www.gluster.org/mailman/listinfo/gluster-devel
>
>
>------------------------------
>
>Message: 3
>Date: Mon, 30 Nov 2015 15:56:15 +0100
>From: Niels de Vos <ndevos at redhat.com>
>To: gluster-users at gluster.org, gluster-devel at gluster.org
>Subject: [Gluster-users] Assistance needed for testing Gluster in the
> CentOS CI infrastructure
>Message-ID: <20151130145615.GP2547 at ndevos-x240.usersys.redhat.com>
>Content-Type: text/plain; charset="us-ascii"
>
>Hi!
>
>We're looking for interested users and developers that can spend some
>time on setting up tests for Gluster in the CentOS CI infrastructure.
>Gluster is part of the CentOS Storage SIG, and that enables us to use
>the CentOS CI testing systems.
>
>I would like to have a few volunteers that are willing to create the
>first Jenkins jobs for Gluster on the CentOS CI. This is not a common
>Jenkins environment like we have on build.gluster.org. On ci.centos.org
>the Jenkins slaves function as a management node which reserve
>additional (non Jenkins slaves) for running tests. It will require some
>dedicated time to understand the available infrastructure and get
>something useful out of it. There are several CentOS admins/developers
>that are willing to explain and help with the testing, but we need some
>people that can take care of it from a Gluster perspective.
>
>Some links that would be of interest for this work:
> - http://wiki.centos.org/QaWiki/CI
> - https://wiki.centos.org/SpecialInterestGroup/Storage
> - https://github.com/gluster/glusterfs/blob/master/doc/developer-guide/Using-Gluster-Test-Framework.md
>
>Anyone that is interested and can regularly spend a little time on this
>is most welcome to sign up. Please contact me and I'll try to get a
>little group on its way.
>
>Thanks,
>Niels
>-------------- next part --------------
>A non-text attachment was scrubbed...
>Name: signature.asc
>Type: application/pgp-signature
>Size: 819 bytes
>Desc: not available
>URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20151130/9655092f/attachment-0001.sig>
>
>------------------------------
>
>Message: 4
>Date: Mon, 30 Nov 2015 16:32:33 +0000
>From: "Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC]"
> <uthra.r.rao at nasa.gov>
>To: Vijay Bellur <vbellur at redhat.com>
>Cc: "gluster-users at gluster.org" <gluster-users at gluster.org>
>Subject: Re: [Gluster-users] Glusterfs - Translators/Performance
>Message-ID:
> <B8DFB8650EABA347A6A9036FE8936CA80C6BB7D5 at NDMSMBX403.ndc.nasa.gov>
>Content-Type: text/plain; charset="utf-8"
>
>Thank you Vijay for taking the time to reply.
>
>What we want is writes to be a bit better than the 10MBps we are seeing but not as important as read which is good at 400MBps.
>
>Is it better to store settings in /etc/glusterfs/glusterd.vol (as in the docs) or with "gluster set" (on command line as most posts seem to use)?
>
>Does only one of performance/io-threads, performance/io-cache, performance/writebehind translators take effect or are they all in effect? Are they ON by default?
>
>We currently only installed gluster client on our clients, which doesn't have the gluster command for settings the properties.
>Should we install gluster server on our clients also to change gluster client properties?
>
>Thank you.
>Uthra
>
>
>
>
>
>-----Original Message-----
>From: Vijay Bellur [mailto:vbellur at redhat.com]
>Sent: Friday, November 27, 2015 7:48 PM
>To: Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC]
>Cc: gluster-users at gluster.org
>Subject: Re: [Gluster-users] Glusterfs - Translators/Performance
>
>
>
>----- Original Message -----
>> From: "Uthra R. Rao (GSFC-672.0)[ADNET SYSTEMS INC]"
>> <uthra.r.rao at nasa.gov>
>> To: gluster-users at gluster.org
>> Sent: Friday, November 27, 2015 1:19:12 PM
>> Subject: [Gluster-users] Glusterfs - Translators/Performance
>>
>>
>>
>> I was reading this link and was not sure if these settings go in to
>> /etc/glusterfs/glusterd.vol? Do I have to just edit this file to add
>> the setting?
>>
>>
>>
>> http://www.gluster.org/community/documentation/index.php/Translators/p
>> erformance
>>
>>
>>
>> do we have to choose between writebehind, io-threads, io-cache?
>>
>
>
>By default all gluster volumes have these capabilities built in. What is your workload and what is the nature of performance improvements that you are looking forward to?
>
>Thanks,
>Vijay
>
>------------------------------
>
>Message: 5
>Date: Mon, 30 Nov 2015 08:38:04 -0800
>From: Joe Julian <joe at julianfamily.org>
>To: gluster-users at gluster.org
>Subject: Re: [Gluster-users] Glusterfs - Translators/Performance
>Message-ID: <565C7B6C.7010807 at julianfamily.org>
>Content-Type: text/plain; charset=windows-1252; format=flowed
>
>
>
>On 11/30/2015 08:32 AM, Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] wrote:
>> Thank you Vijay for taking the time to reply.
>>
>> What we want is writes to be a bit better than the 10MBps we are seeing but not as important as read which is good at 400MBps.
>
>That's what results you're looking for, but nothing about the workload.
>
>>
>> Is it better to store settings in /etc/glusterfs/glusterd.vol (as in the docs) or with "gluster set" (on command line as most posts seem to use)?
>
>s/docs/wiki pages for the 3.2ish version/
>
>>
>> Does only one of performance/io-threads, performance/io-cache, performance/writebehind translators take effect or are they all in effect? Are they ON by default?
>>
>> We currently only installed gluster client on our clients, which doesn't have the gluster command for settings the properties.
>> Should we install gluster server on our clients also to change gluster client properties?
>
>Changes made through the cli (gluster volume set) change the volume
>configuration state. You can see those state files under
>/var/lib/glusterd/vols/$volname. The *fuse.vol file is what the client
>retrieves from the servers at mount time or when there's a change that
>affects the client.
>
>>
>> Thank you.
>> Uthra
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: Vijay Bellur [mailto:vbellur at redhat.com]
>> Sent: Friday, November 27, 2015 7:48 PM
>> To: Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC]
>> Cc: gluster-users at gluster.org
>> Subject: Re: [Gluster-users] Glusterfs - Translators/Performance
>>
>>
>>
>> ----- Original Message -----
>>> From: "Uthra R. Rao (GSFC-672.0)[ADNET SYSTEMS INC]"
>>> <uthra.r.rao at nasa.gov>
>>> To: gluster-users at gluster.org
>>> Sent: Friday, November 27, 2015 1:19:12 PM
>>> Subject: [Gluster-users] Glusterfs - Translators/Performance
>>>
>>>
>>>
>>> I was reading this link and was not sure if these settings go in to
>>> /etc/glusterfs/glusterd.vol? Do I have to just edit this file to add
>>> the setting?
>>>
>>>
>>>
>>> http://www.gluster.org/community/documentation/index.php/Translators/p
>>> erformance
>>>
>>>
>>>
>>> do we have to choose between writebehind, io-threads, io-cache?
>>>
>>
>> By default all gluster volumes have these capabilities built in. What is your workload and what is the nature of performance improvements that you are looking forward to?
>>
>> Thanks,
>> Vijay
>> _______________________________________________
>> Gluster-users mailing list
>> Gluster-users at gluster.org
>> http://www.gluster.org/mailman/listinfo/gluster-users
>
>
>
>------------------------------
>
>Message: 6
>Date: Mon, 30 Nov 2015 20:43:11 +0000
>From: "Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC]"
> <uthra.r.rao at nasa.gov>
>To: "gluster-users at gluster.org" <gluster-users at gluster.org>
>Subject: [Gluster-users] unable to mount gluster volume on the client
>Message-ID:
> <B8DFB8650EABA347A6A9036FE8936CA80C6BB98E at NDMSMBX403.ndc.nasa.gov>
>Content-Type: text/plain; charset="us-ascii"
>
>
>I am unable to mount the glusterfs on the client. In the client log file I am seeing this message every time I try to mount. To troubleshoot this I set:
>
>#gluster volume set gtower auth.allow IPAddress_client
>
>
>Log messages:
>[2015-11-30 20:38:43.670832] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-gtower-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
>[2015-11-30 20:38:43.671062] W [MSGID: 114043] [client-handshake.c:1114:client_setvolume_cbk] 0-gtower-client-1: failed to set the volume [Permission denied]
>[2015-11-30 20:38:43.671087] W [MSGID: 114007] [client-handshake.c:1143:client_setvolume_cbk] 0-gtower-client-1: failed to get 'process-uuid' from reply dict [Invalid argument]
>[2015-11-30 20:38:43.671098] E [MSGID: 114044] [client-handshake.c:1149:client_setvolume_cbk] 0-gtower-client-1: SETVOLUME on remote-host failed [Permission denied]
>[2015-11-30 20:38:43.671107] I [MSGID: 114049] [client-handshake.c:1240:client_setvolume_cbk] 0-gtower-client-1: sending AUTH_FAILED event
>[2015-11-30 20:38:43.671125] E [fuse-bridge.c:5214:notify] 0-fuse: Server authenication failed. Shutting down.
>[2015-11-30 20:38:43.671165] W [glusterfsd.c:1236:cleanup_and_exit] (-->/lib64/libpthread.so.0() [0x3809007a51] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xcd) [0x405e6d] -->/usr/sbin/glusterfs(cleanup_and_exit+0x65) [0x4059d5] ) 0-: received signum (15), shutting down
>
>
>Has anyone had this issue and how did you resolve it. I would appreciate some help.
>
>Thank you.
>Uthra
>-------------- next part --------------
>An HTML attachment was scrubbed...
>URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20151130/3c2ada37/attachment-0001.html>
>
>------------------------------
>
>Message: 7
>Date: Mon, 30 Nov 2015 21:19:05 +0000
>From: "Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC]"
> <uthra.r.rao at nasa.gov>
>To: Joe Julian <joe at julianfamily.org>, "gluster-users at gluster.org"
> <gluster-users at gluster.org>
>Subject: Re: [Gluster-users] Glusterfs - Translators/Performance
>Message-ID:
> <B8DFB8650EABA347A6A9036FE8936CA80C6BBB19 at NDMSMBX403.ndc.nasa.gov>
>Content-Type: text/plain; charset="us-ascii"
>
>Joe,
>
>Thank you.
>
>That's what results you're looking for, but nothing about the workload
>---We are in the testing phase and right now the there is no workload.
>
>s/docs/wiki pages for the 3.2ish version/
>--- Not sure where to look Please send me the complete URL
>
>
>Uthra
>
>
>-----Original Message-----
>From: gluster-users-bounces at gluster.org [mailto:gluster-users-bounces at gluster.org] On Behalf Of Joe Julian
>Sent: Monday, November 30, 2015 11:38 AM
>To: gluster-users at gluster.org
>Subject: Re: [Gluster-users] Glusterfs - Translators/Performance
>
>
>
>On 11/30/2015 08:32 AM, Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] wrote:
>> Thank you Vijay for taking the time to reply.
>>
>> What we want is writes to be a bit better than the 10MBps we are seeing but not as important as read which is good at 400MBps.
>
>That's what results you're looking for, but nothing about the workload.
>
>>
>> Is it better to store settings in /etc/glusterfs/glusterd.vol (as in the docs) or with "gluster set" (on command line as most posts seem to use)?
>
>s/docs/wiki pages for the 3.2ish version/
>
>>
>> Does only one of performance/io-threads, performance/io-cache, performance/writebehind translators take effect or are they all in effect? Are they ON by default?
>>
>> We currently only installed gluster client on our clients, which doesn't have the gluster command for settings the properties.
>> Should we install gluster server on our clients also to change gluster client properties?
>
>Changes made through the cli (gluster volume set) change the volume configuration state. You can see those state files under /var/lib/glusterd/vols/$volname. The *fuse.vol file is what the client retrieves from the servers at mount time or when there's a change that affects the client.
>
>>
>> Thank you.
>> Uthra
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: Vijay Bellur [mailto:vbellur at redhat.com]
>> Sent: Friday, November 27, 2015 7:48 PM
>> To: Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC]
>> Cc: gluster-users at gluster.org
>> Subject: Re: [Gluster-users] Glusterfs - Translators/Performance
>>
>>
>>
>> ----- Original Message -----
>>> From: "Uthra R. Rao (GSFC-672.0)[ADNET SYSTEMS INC]"
>>> <uthra.r.rao at nasa.gov>
>>> To: gluster-users at gluster.org
>>> Sent: Friday, November 27, 2015 1:19:12 PM
>>> Subject: [Gluster-users] Glusterfs - Translators/Performance
>>>
>>>
>>>
>>> I was reading this link and was not sure if these settings go in to
>>> /etc/glusterfs/glusterd.vol? Do I have to just edit this file to add
>>> the setting?
>>>
>>>
>>>
>>> http://www.gluster.org/community/documentation/index.php/Translators/
>>> p
>>> erformance
>>>
>>>
>>>
>>> do we have to choose between writebehind, io-threads, io-cache?
>>>
>>
>> By default all gluster volumes have these capabilities built in. What is your workload and what is the nature of performance improvements that you are looking forward to?
>>
>> Thanks,
>> Vijay
>> _______________________________________________
>> Gluster-users mailing list
>> Gluster-users at gluster.org
>> http://www.gluster.org/mailman/listinfo/gluster-users
>
>_______________________________________________
>Gluster-users mailing list
>Gluster-users at gluster.org
>http://www.gluster.org/mailman/listinfo/gluster-users
>
>
>------------------------------
>
>Message: 8
>Date: Mon, 30 Nov 2015 16:57:58 -0500 (EST)
>From: Vijay Bellur <vbellur at redhat.com>
>To: "Uthra R. Rao (GSFC-672.0)[ADNET SYSTEMS INC]"
> <uthra.r.rao at nasa.gov>
>Cc: gluster-users at gluster.org
>Subject: Re: [Gluster-users] Glusterfs - Translators/Performance
>Message-ID:
> <708610316.30692028.1448920678037.JavaMail.zimbra at redhat.com>
>Content-Type: text/plain; charset=utf-8
>
>
>
>----- Original Message -----
>> From: "Uthra R. Rao (GSFC-672.0)[ADNET SYSTEMS INC]" <uthra.r.rao at nasa.gov>
>> To: "Joe Julian" <joe at julianfamily.org>, gluster-users at gluster.org
>> Sent: Monday, November 30, 2015 4:19:05 PM
>> Subject: Re: [Gluster-users] Glusterfs - Translators/Performance
>>
>> Joe,
>>
>> Thank you.
>>
>> That's what results you're looking for, but nothing about the workload
>> ---We are in the testing phase and right now the there is no workload.
>>
>
>How is the write performance being characterized in your testing?
>
>Thanks,
>Vijay
>
>
>------------------------------
>
>Message: 9
>Date: Mon, 30 Nov 2015 17:19:51 -0500 (EST)
>From: Vijay Bellur <vbellur at redhat.com>
>To: "Uthra R. Rao (GSFC-672.0)[ADNET SYSTEMS INC]"
> <uthra.r.rao at nasa.gov>
>Cc: gluster-users at gluster.org
>Subject: Re: [Gluster-users] Glusterfs - Translators/Performance
>Message-ID:
> <587766648.30705189.1448921991734.JavaMail.zimbra at redhat.com>
>Content-Type: text/plain; charset=utf-8
>
>
>
>----- Original Message -----
>> From: "Uthra R. Rao (GSFC-672.0)[ADNET SYSTEMS INC]" <uthra.r.rao at nasa.gov>
>> To: "Vijay Bellur" <vbellur at redhat.com>
>> Cc: gluster-users at gluster.org
>> Sent: Monday, November 30, 2015 11:32:33 AM
>> Subject: RE: [Gluster-users] Glusterfs - Translators/Performance
>>
>> Thank you Vijay for taking the time to reply.
>>
>> What we want is writes to be a bit better than the 10MBps we are seeing but
>> not as important as read which is good at 400MBps.
>>
>> Is it better to store settings in /etc/glusterfs/glusterd.vol (as in the
>> docs) or with "gluster set" (on command line as most posts seem to use)?se
>
>settings in /etc/glusterfs/glusterd.vol are meant for the management daemon i.e. glusterd.
>
>All tuning needed for volume services would need to be done through the "gluster volume set" interface.
>
>>
>> Does only one of performance/io-threads, performance/io-cache,
>> performance/writebehind translators take effect or are they all in effect?
>> Are they ON by default?
>>
>
>Yes, all these translators are ON by default.
>
>
>> We currently only installed gluster client on our clients, which doesn't have
>> the gluster command for settings the properties.
>> Should we install gluster server on our clients also to change gluster client
>> properties?
>>
>
>gluster client properties cannot be set per client through "volume set" CLI. The properties altered through "volume set" are applicable to all clients by default. Per client behavior can be altered at the time of mounting a gluster volume.
>
>Regards,
>Vijay
>
>
>------------------------------
>
>Message: 10
>Date: Mon, 30 Nov 2015 22:45:34 +0000
>From: "Andrus, Brian Contractor" <bdandrus at nps.edu>
>To: "gluster-users at gluster.org" <gluster-users at gluster.org>
>Subject: [Gluster-users] Why oh why does gluster delay?
>Message-ID:
> <ADC981242279AD408816CB7141A2789DD797F890 at GROWLER.ern.nps.edu>
>Content-Type: text/plain; charset="us-ascii"
>
>All,
>
>I am seeing it VERY consistently that when I do a 'gluster peer status' or 'gluster pool list', the system 'hangs' for up to 1 minute before spitting back results.
>
>I have 10 nodes all on the same network and currently ZERO volumes or bricks configured. Just trying to get good performance for the cluster to be talking to itself....
>
>
>What is gluster doing that takes so long to respond? Seems there may be a more efficient way of doing it, whatever it is...
>
>
>
>Brian Andrus
>ITACS/Research Computing
>Naval Postgraduate School
>Monterey, California
>voice: 831-656-6238
>
>
>-------------- next part --------------
>An HTML attachment was scrubbed...
>URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20151130/841d469b/attachment-0001.html>
>
>------------------------------
>
>Message: 11
>Date: Mon, 30 Nov 2015 23:45:49 +0100
>From: Milo? Koz?k <milos.kozak at lejmr.com>
>To: gluster-users <gluster-users at gluster.org>
>Subject: [Gluster-users] Split-brain after uploading file
>Message-ID: <CF7C4391-EDDA-4286-B160-69BC7DE53F83 at lejmr.com>
>Content-Type: text/plain; charset="utf-8"
>
>I am using Gluster for a few years without any significant issue (after I tweaked configuration for v3.5). My configuration is as follows:
>
>network.remote-dio: enable
>cluster.eager-lock: enable
>performance.stat-prefetch: off
>performance.io-cache: off
>performance.read-ahead: off
>performance.quick-read: off
>performance.io-thread-count: 6
>network.ping-timeout: 2
>performance.cache-max-file-size: 0
>performance.flush-behind: on
>features.barrier: disable
>snap-max-soft-limit: 7
>auto-delete: on
>
>I use it for running virtual servers on top such a volume. Currently I run this version of Gluster:
>
>glusterfs-cli-3.6.5-1.el6.x86_64
>glusterfs-3.6.5-1.el6.x86_64
>glusterfs-api-3.6.5-1.el6.x86_64
>glusterfs-server-3.6.5-1.el6.x86_64
>glusterfs-libs-3.6.5-1.el6.x86_64
>glusterfs-fuse-3.6.5-1.el6.x86_64
>
>With recent CentOS 6.
>
>I have experienced an issue when I move some files from an hdd onto gluster volume such that one node gets overloaded in the middle of file upload. Therefore, I decided to upload it through ssh onto other server than where original images are store. I know that this sounds just weird, but it does not lead to overloading!
>
>Along these lines, I decided to upload 10G image onto gluster volume and the upload speed varied, but no overloading at all? Right after upload was done I realized that some virtuals are not running properly. Hence I checked heal status where I discoverd that 4 images are in split-brain state. I had to act quickly, so I resolved the split brain, and let gluster heal. When heal was done everything works?
>
>However, I have got a few more VMs to upload, and I am not sure what can happen..
>
>My volume configuration:
>
>Volume Name: ph-fs-0
>Type: Replicate
>Volume ID: 71ac6456-03e4-4bb3-a624-937f4605b2cb
>Status: Started
>Number of Bricks: 1 x 2 = 2
>Transport-type: tcp
>Bricks:
>Brick1: 10.11.100.1:/gfs/s3-sata-10k/fs
>Brick2: 10.11.100.2:/gfs/s3-sata-10k/fs
>Options Reconfigured:
>network.remote-dio: enable
>cluster.eager-lock: enable
>performance.stat-prefetch: off
>performance.io-cache: off
>performance.read-ahead: off
>performance.quick-read: off
>performance.io-thread-count: 6
>network.ping-timeout: 2
>performance.cache-max-file-size: 0
>performance.flush-behind: on
>features.barrier: disable
>snap-max-soft-limit: 7
>auto-delete: on
>
>
>and logs are attached.
>
>Milo?
>-------------- next part --------------
>A non-text attachment was scrubbed...
>Name: glustershd.log
>Type: application/octet-stream
>Size: 9071 bytes
>Desc: not available
>URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20151130/69e54bf1/attachment-0002.obj>
>-------------- next part --------------
>A non-text attachment was scrubbed...
>Name: var-lib-one-datastores-103.log
>Type: application/octet-stream
>Size: 122560 bytes
>Desc: not available
>URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20151130/69e54bf1/attachment-0003.obj>
>
>------------------------------
>
>Message: 12
>Date: Tue, 1 Dec 2015 09:38:38 +0530
>From: Atin Mukherjee <amukherj at redhat.com>
>To: "Andrus, Brian Contractor" <bdandrus at nps.edu>,
> "gluster-users at gluster.org" <gluster-users at gluster.org>
>Subject: Re: [Gluster-users] Why oh why does gluster delay?
>Message-ID: <565D1D46.5090806 at redhat.com>
>Content-Type: text/plain; charset=windows-1252
>
>
>
>On 12/01/2015 04:15 AM, Andrus, Brian Contractor wrote:
>> All,
>>
>>
>>
>> I am seeing it VERY consistently that when I do a ?gluster peer status?
>> or ?gluster pool list?, the system ?hangs? for up to 1 minute before
>> spitting back results.
>That's interesting, 'gluster peer status' or 'pool list' is a local node
>operation and doesn't incur RPC calls. Until and unless it takes time to
>communicate back to CLI because of a poor N/W, I don't see any reason
>why would it take such a long time. Can you run glusterd with debug log
>enabled and share the *glusterd.log file with us?
>
>~Atin
>>
>>
>>
>> I have 10 nodes all on the same network and currently ZERO volumes or
>> bricks configured. Just trying to get good performance for the cluster
>> to be talking to itself?.
>>
>>
>>
>>
>>
>> What is gluster doing that takes so long to respond? Seems there may be
>> a more efficient way of doing it, whatever it is?
>>
>>
>>
>>
>>
>>
>>
>> Brian Andrus
>>
>> ITACS/Research Computing
>>
>> Naval Postgraduate School
>>
>> Monterey, California
>>
>> voice: 831-656-6238
>>
>>
>>
>>
>>
>>
>>
>> _______________________________________________
>> Gluster-users mailing list
>> Gluster-users at gluster.org
>> http://www.gluster.org/mailman/listinfo/gluster-users
>>
>
>
>------------------------------
>
>Message: 13
>Date: Tue, 1 Dec 2015 06:30:24 -0500 (EST)
>From: Manikandan Selvaganesh <mselvaga at redhat.com>
>To: Gluster Devel <gluster-devel at gluster.org>,
> gluster-users at gluster.org
>Subject: [Gluster-users] REMINDER: Gluster Community Bug Triage
> meeting at 12:00 UTC (~in 30 minutes)
>Message-ID:
> <165308430.24364860.1448969424446.JavaMail.zimbra at redhat.com>
>Content-Type: text/plain; charset=utf-8
>
>Hi all,
>
>This meeting is scheduled for anyone that is interested in learning more
>about, or assisting with the Bug Triage.
>
>Meeting details:
>- location: #gluster-meeting on Freenode IRC
> (https://webchat.freenode.net/?channels=gluster-meeting )
>- date: every Tuesday
>- time: 12:00 UTC
> (in your terminal, run: date -d "12:00 UTC")
>- agenda: https://public.pad.fsfe.org/p/gluster-bug-triage
>
>Currently the following items are listed:
>* Roll Call
>* Status of last weeks action items
>* Group Triage
>* Open Floor
>
>The last two topics have space for additions. If you have a suitable bug
>or topic to discuss, please add it to the agenda.
>
>Appreciate your participation.
>
>Thank you :-)
>
>--
>Regards,
>Manikandan Selvaganesh.
>
>
>
>------------------------------
>
>_______________________________________________
>Gluster-users mailing list
>Gluster-users at gluster.org
>http://www.gluster.org/mailman/listinfo/gluster-users
>
>End of Gluster-users Digest, Vol 92, Issue 1
>********************************************
More information about the Gluster-users
mailing list