<div dir="ltr"><div><div>Hi,<br><br></div>I have a situation<br><br></div>the volume logfile reports a possible split-brain but when I try to heal it fails because the file is not in split-brain. Any ideas?<br><br><br><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:~# uname -a</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Linux chastcvtprd04 4.4.0-66-generic #87-Ubuntu SMP Fri Mar 3 15:29:05 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:~# dpkg -l | grep gluster</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">ii  glusterfs-client                    3.8.8-ubuntu1~xenial1              amd64        clustered file-system (client package)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">ii  glusterfs-common                    3.8.8-ubuntu1~xenial1              amd64        GlusterFS common libraries and translator modules</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">ii  glusterfs-server                    3.8.8-ubuntu1~xenial1              amd64        clustered file-system (server package)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:~# gluster volume info Server_Legal_01</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Volume Name: Server_Legal_01</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Type: Replicate</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Volume ID: ce6426a8-6fd2-4f34-bb04-7817cea598fb</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Status: Started</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Snapshot Count: 0</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Number of Bricks: 1 x 2 = 2</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Transport-type: tcp</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Bricks:</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Brick1: chastcvtprd04:/data/glusterfs/Server_Legal/2I-1-32/brick</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Brick2: chglbcvtprd04:/data/glusterfs/Server_Legal/2I-1-32/brick</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Options Reconfigured:</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">auth.allow: 127.0.0.1,10.30.28.43,10.30.28.44</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">nfs.disable: on</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">performance.readdir-ahead: on</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">diagnostics.latency-measurement: on</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">diagnostics.count-fop-hits: on</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">features.bitrot: on</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">features.scrub: Active</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:~# ls -l /data/simpana/Data/Server_Legal_01/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">-rw-rw-rw- 1 root simpana 27357050 Jan 11 21:21 /data/simpana/Data/Server_Legal_01/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:~# sha256sum /data/simpana/Data/Server_Legal_01/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">sha256sum: /data/simpana/Data/Server_Legal_01/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046: Input/output error</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:~# gluster volume heal Server_Legal_01 info</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Brick chastcvtprd04:/data/glusterfs/Server_Legal/2I-1-32/brick</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Status: Connected</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Number of entries: 0</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Brick chglbcvtprd04:/data/glusterfs/Server_Legal/2I-1-32/brick</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Status: Connected</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Number of entries: 0</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span lang="DE-CH">root@chastcvtprd04:~# getfattr -d -e hex -m . <span class="gmail-Apple-converted-space"> </span></span>/data/glusterfs/Server_Legal/2I-1-32/brick/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">getfattr: Removing leading &#39;/&#39; from absolute path names</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"># file: data/glusterfs/Server_Legal/2I-1-32/brick/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">trusted.afr.dirty=0x000000000000000000000000</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">trusted.bit-rot.bad-file=0x3100</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">trusted.bit-rot.signature=0x010500000000000000164947a36f9e22b5dcdfb4cf69d809396302de9d6a9b3f266532e40ddc45db04</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">trusted.bit-rot.version=0x0500000000000000585818d80008b694</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">trusted.gfid=0xbfdfe21a1af3474ba6a4bc0e17edb529</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span lang="DE-CH">root@chglbcvtprd04:~# getfattr -d -e hex -m . <span class="gmail-Apple-converted-space"> </span></span>/data/glusterfs/Server_Legal/2I-1-32/brick/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">getfattr: Removing leading &#39;/&#39; from absolute path names</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"># file: data/glusterfs/Server_Legal/2I-1-32/brick/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">trusted.afr.dirty=0x000000000000000000000000</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">trusted.bit-rot.bad-file=0x3100</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">trusted.bit-rot.signature=0x010500000000000000164947a36f9e22b5dcdfb4cf69d809396302de9d6a9b3f266532e40ddc45db04</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">trusted.bit-rot.version=0x050000000000000058580d5f0001543b</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">trusted.gfid=0xbfdfe21a1af3474ba6a4bc0e17edb529</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:~# sha256sum  /data/glusterfs/Server_Legal/2I-1-32/brick/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">6334395ab5eae6c9956ca82b76e2f0124aff3eb3a50ef6ebccbdccad65525f73  /data/glusterfs/Server_Legal/2I-1-32/brick/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chglbcvtprd04:~# sha256sum  /data/glusterfs/Server_Legal/2I-1-32/brick/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">6334395ab5eae6c9956ca82b76e2f0124aff3eb3a50ef6ebccbdccad65525f73  /data/glusterfs/Server_Legal/2I-1-32/brick/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:~# ls -li  /data/glusterfs/Server_Legal/2I-1-32/brick/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">1163752 -rw-rw-rw- 2 root simpana 27357050 Jan 11 21:21 /data/glusterfs/Server_Legal/2I-1-32/brick/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:~# find /data/glusterfs/Server_Legal/2I-1-32/brick -inum 1163752</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">/data/glusterfs/Server_Legal/2I-1-32/brick/.glusterfs/bf/df/bfdfe21a-1af3-474b-a6a4-bc0e17edb529</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">/data/glusterfs/Server_Legal/2I-1-32/brick/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chglbcvtprd04:~# ls -li /data/glusterfs/Server_Legal/2I-1-32/brick/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">12886039523 -rw-rw-rw- 2 root simpana 27357050 Jan 11 21:21 /data/glusterfs/Server_Legal/2I-1-32/brick/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chglbcvtprd04:~# find /data/glusterfs/Server_Legal/2I-1-32/brick -inum  12886039523</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">/data/glusterfs/Server_Legal/2I-1-32/brick/.glusterfs/bf/df/bfdfe21a-1af3-474b-a6a4-bc0e17edb529</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">/data/glusterfs/Server_Legal/2I-1-32/brick/Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:/var/log/glusterfs# ls -lrt *Server_Legal_01*.log</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">-rw------- 1 root root 2024748 Mar 17 20:50 data-simpana-Data-Server_Legal_01.log</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">-rw------- 1 root root  251700 Mar 17 20:54 glfsheal-Server_Legal_01.log</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:/var/log/glusterfs#</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:/var/log/glusterfs# tail -100 data-simpana-Data-Server_Legal_01.log</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.122616] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid c5a0afdf-3114-4b2f-9664-b00255a08b1b: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.122949] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c5a0afdf-3114-4b2f-9664-b00255a08b1b. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.123099] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.123385] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.123407] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid c5a0afdf-3114-4b2f-9664-b00255a08b1b: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.137285] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.137498] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9283240/SFILE_CONTAINER_080 (c5a0afdf-3114-4b2f-9664-b00255a08b1b) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.137837] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9283240/SFILE_CONTAINER_080 (c5a0afdf-3114-4b2f-9664-b00255a08b1b) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.137875] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f9dfb0f9440, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9283240/SFILE_CONTAINER_080 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.137917] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 321134: READ =&gt; -1 gfid=c5a0afdf-3114-4b2f-9664-b00255a08b1b fd=0x7f9dfb0f9440 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.137994] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c5a0afdf-3114-4b2f-9664-b00255a08b1b. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.138172] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.138484] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.138505] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid c5a0afdf-3114-4b2f-9664-b00255a08b1b: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.138802] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c5a0afdf-3114-4b2f-9664-b00255a08b1b. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.138989] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.139241] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.139246] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid c5a0afdf-3114-4b2f-9664-b00255a08b1b: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.139793] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.139966] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9283240/SFILE_CONTAINER_080 (c5a0afdf-3114-4b2f-9664-b00255a08b1b) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.140245] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9283240/SFILE_CONTAINER_080 (c5a0afdf-3114-4b2f-9664-b00255a08b1b) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.140274] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f9dfb0f9440, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9283240/SFILE_CONTAINER_080 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:36.140316] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 321135: READ =&gt; -1 gfid=c5a0afdf-3114-4b2f-9664-b00255a08b1b fd=0x7f9dfb0f9440 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.802878] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4619a256-3787-4c06-ac57-33dfb174456e. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.803128] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.803342] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.803373] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid 4619a256-3787-4c06-ac57-33dfb174456e: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.803524] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4619a256-3787-4c06-ac57-33dfb174456e. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.803692] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.803999] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.804020] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid 4619a256-3787-4c06-ac57-33dfb174456e: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.804576] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.804746] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9286373/SFILE_CONTAINER_070 (4619a256-3787-4c06-ac57-33dfb174456e) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.805046] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9286373/SFILE_CONTAINER_070 (4619a256-3787-4c06-ac57-33dfb174456e) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.805078] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f9dfb0f94cc, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9286373/SFILE_CONTAINER_070 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.805120] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 332890: READ =&gt; -1 gfid=4619a256-3787-4c06-ac57-33dfb174456e fd=0x7f9dfb0f94cc (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.805177] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4619a256-3787-4c06-ac57-33dfb174456e. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.805353] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.805690] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.805712] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid 4619a256-3787-4c06-ac57-33dfb174456e: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.806462] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4619a256-3787-4c06-ac57-33dfb174456e. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.806663] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.806944] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.806950] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid 4619a256-3787-4c06-ac57-33dfb174456e: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.807486] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.807651] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9286373/SFILE_CONTAINER_070 (4619a256-3787-4c06-ac57-33dfb174456e) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.807993] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9286373/SFILE_CONTAINER_070 (4619a256-3787-4c06-ac57-33dfb174456e) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.808044] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f9dfb0f94cc, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9286373/SFILE_CONTAINER_070 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:47.808086] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 332891: READ =&gt; -1 gfid=4619a256-3787-4c06-ac57-33dfb174456e fd=0x7f9dfb0f94cc (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:11:20.346125] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid 6de87045-ece9-40e8-bdf3-7dad12de561f: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6de87045-ece9-40e8-bdf3-7dad12de561f. (Possible split-brain)&quot; repeated 3 times between [2017-03-17 19:11:20.343014] and [2017-03-17 19:11:20.346996]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.771690] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1b7d36fc-fe3f-4e4c-91a5-4a33dd7884bc. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.771978] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.772209] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.772228] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid 1b7d36fc-fe3f-4e4c-91a5-4a33dd7884bc: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.772958] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid 1b7d36fc-fe3f-4e4c-91a5-4a33dd7884bc: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.773509] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.773677] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9288450/SFILE_CONTAINER_116 (1b7d36fc-fe3f-4e4c-91a5-4a33dd7884bc) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.774045] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9288450/SFILE_CONTAINER_116 (1b7d36fc-fe3f-4e4c-91a5-4a33dd7884bc) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.774132] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f9dfb0f9184, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9288450/SFILE_CONTAINER_116 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.774218] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 345004: READ =&gt; -1 gfid=1b7d36fc-fe3f-4e4c-91a5-4a33dd7884bc fd=0x7f9dfb0f9184 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]&quot; repeated 3 times between [2017-03-17 19:12:59.772209] and [2017-03-17 19:12:59.775988]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.775996] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid 1b7d36fc-fe3f-4e4c-91a5-4a33dd7884bc: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.776538] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.776814] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9288450/SFILE_CONTAINER_116 (1b7d36fc-fe3f-4e4c-91a5-4a33dd7884bc) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.777067] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9288450/SFILE_CONTAINER_116 (1b7d36fc-fe3f-4e4c-91a5-4a33dd7884bc) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.777131] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 345006: READ =&gt; -1 gfid=1b7d36fc-fe3f-4e4c-91a5-4a33dd7884bc fd=0x7f9dfb0f9184 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.774854] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid 1b7d36fc-fe3f-4e4c-91a5-4a33dd7884bc: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1b7d36fc-fe3f-4e4c-91a5-4a33dd7884bc. (Possible split-brain)&quot; repeated 3 times between [2017-03-17 19:12:59.771690] and [2017-03-17 19:12:59.775548]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]&quot; repeated 3 times between [2017-03-17 19:12:59.771978] and [2017-03-17 19:12:59.775719]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:59.777105] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f9dfb0f9184, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944459/CHUNK_9288450/SFILE_CONTAINER_116 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:26:51.275897] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bfdfe21a-1af3-474b-a6a4-bc0e17edb529. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:26:51.276390] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing GETXATTR on gfid bfdfe21a-1af3-474b-a6a4-bc0e17edb529: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:26:51.276427] W [fuse-bridge.c:3441:fuse_xattr_cbk] 0-glusterfs-fuse: 1154312: GETXATTR((null)) /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046 =&gt; -1 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.076750] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bfdfe21a-1af3-474b-a6a4-bc0e17edb529. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.077000] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.077259] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.077294] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid bfdfe21a-1af3-474b-a6a4-bc0e17edb529: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.078283] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid bfdfe21a-1af3-474b-a6a4-bc0e17edb529: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.078337] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid bfdfe21a-1af3-474b-a6a4-bc0e17edb529: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.088463] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.088539] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.088830] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046 (bfdfe21a-1af3-474b-a6a4-bc0e17edb529) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.088867] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046 (bfdfe21a-1af3-474b-a6a4-bc0e17edb529) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.089012] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046 (bfdfe21a-1af3-474b-a6a4-bc0e17edb529) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.089060] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f9dfb0f9184, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.089081] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046 (bfdfe21a-1af3-474b-a6a4-bc0e17edb529) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.089107] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 2491526: READ =&gt; -1 gfid=bfdfe21a-1af3-474b-a6a4-bc0e17edb529 fd=0x7f9dfb0f9184 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.089124] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f9dfb0f9184, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.089165] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 2491525: READ =&gt; -1 gfid=bfdfe21a-1af3-474b-a6a4-bc0e17edb529 fd=0x7f9dfb0f9184 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]&quot; repeated 5 times between [2017-03-17 19:49:56.077259] and [2017-03-17 19:49:56.090419]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.090426] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid bfdfe21a-1af3-474b-a6a4-bc0e17edb529: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.091034] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.091201] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046 (bfdfe21a-1af3-474b-a6a4-bc0e17edb529) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.091519] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046 (bfdfe21a-1af3-474b-a6a4-bc0e17edb529) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.091578] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 2491534: READ =&gt; -1 gfid=bfdfe21a-1af3-474b-a6a4-bc0e17edb529 fd=0x7f9dfb0f9184 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid bfdfe21a-1af3-474b-a6a4-bc0e17edb529: split-brain observed. [Input/output error]&quot; repeated 2 times between [2017-03-17 19:49:56.077294] and [2017-03-17 19:49:56.089723]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bfdfe21a-1af3-474b-a6a4-bc0e17edb529. (Possible split-brain)&quot; repeated 5 times between [2017-03-17 19:49:56.076750] and [2017-03-17 19:49:56.089951]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]&quot; repeated 5 times between [2017-03-17 19:49:56.077000] and [2017-03-17 19:49:56.090086]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:56.091548] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f9dfb0f9184, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9291168/SFILE_CONTAINER_046 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:/var/log/glusterfs#</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:/var/log/glusterfs# tail -100 glfsheal-Server_Legal_01.log</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:19:32.393846] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-1: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:19:32.561091] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-1: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:19:32.561904] I [MSGID: 108031] [afr-common.c:2152:afr_local_discovery_cbk] 0-Server_Legal_01-replicate-0: selecting local read_child Server_Legal_01-client-0</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:19:32.562494] I [MSGID: 104041] [glfs-resolve.c:885:__glfs_active_subvol] 0-Server_Legal_01: switched to graph 63686173-7463-7674-7072-6430342d3334 (0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:55.983126] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 63686173-7463-7674-7072-6430342d3939 (0) coming up</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:55.983162] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-0: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:56.003121] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-1: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:56.003303] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-0: changing port to 49635 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:56.004036] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:56.004251] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-0: Connected to Server_Legal_01-client-0, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:56.004269] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-0: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:56.004307] I [MSGID: 108005] [afr-common.c:4382:afr_notify] 0-Server_Legal_01-replicate-0: Subvolume &#39;Server_Legal_01-client-0&#39; came back up; going online.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:56.004329] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-0: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:56.004367] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-1: changing port to 49658 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:56.005341] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:56.005862] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-1: Connected to Server_Legal_01-client-1, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:56.005877] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-1: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:56.099082] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-1: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:56.099922] I [MSGID: 108031] [afr-common.c:2152:afr_local_discovery_cbk] 0-Server_Legal_01-replicate-0: selecting local read_child Server_Legal_01-client-0</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:23:56.100670] I [MSGID: 104041] [glfs-resolve.c:885:__glfs_active_subvol] 0-Server_Legal_01: switched to graph 63686173-7463-7674-7072-6430342d3939 (0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:07.952797] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 63686173-7463-7674-7072-6430342d3331 (0) coming up</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:07.957727] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-0: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:07.958670] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-1: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:07.958853] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-0: changing port to 49635 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:07.959549] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:07.959819] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-0: Connected to Server_Legal_01-client-0, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:07.959832] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-0: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:07.959865] I [MSGID: 108005] [afr-common.c:4382:afr_notify] 0-Server_Legal_01-replicate-0: Subvolume &#39;Server_Legal_01-client-0&#39; came back up; going online.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:07.959885] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-0: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:07.960019] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-1: changing port to 49658 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:07.960957] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:07.961445] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-1: Connected to Server_Legal_01-client-1, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:07.961457] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-1: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:08.130678] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-1: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:08.131439] I [MSGID: 108031] [afr-common.c:2152:afr_local_discovery_cbk] 0-Server_Legal_01-replicate-0: selecting local read_child Server_Legal_01-client-0</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:34:08.132110] I [MSGID: 104041] [glfs-resolve.c:885:__glfs_active_subvol] 0-Server_Legal_01: switched to graph 63686173-7463-7674-7072-6430342d3331 (0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.730984] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 63686173-7463-7674-7072-6430342d3234 (0) coming up</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.731023] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-0: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.732963] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-1: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.733160] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-0: changing port to 49635 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.733704] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.733952] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-0: Connected to Server_Legal_01-client-0, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.733974] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-0: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.734012] I [MSGID: 108005] [afr-common.c:4382:afr_notify] 0-Server_Legal_01-replicate-0: Subvolume &#39;Server_Legal_01-client-0&#39; came back up; going online.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.734034] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-0: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.734119] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-1: changing port to 49658 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.735092] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.735594] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-1: Connected to Server_Legal_01-client-1, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.735607] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-1: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.935215] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-1: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.936135] I [MSGID: 108031] [afr-common.c:2152:afr_local_discovery_cbk] 0-Server_Legal_01-replicate-0: selecting local read_child Server_Legal_01-client-0</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:36:40.936856] I [MSGID: 104041] [glfs-resolve.c:885:__glfs_active_subvol] 0-Server_Legal_01: switched to graph 63686173-7463-7674-7072-6430342d3234 (0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.745876] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 63686173-7463-7674-7072-6430342d3335 (0) coming up</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.745911] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-0: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.748918] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-1: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.749122] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-0: changing port to 49635 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.749677] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.749980] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-0: Connected to Server_Legal_01-client-0, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.750000] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-0: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.750047] I [MSGID: 108005] [afr-common.c:4382:afr_notify] 0-Server_Legal_01-replicate-0: Subvolume &#39;Server_Legal_01-client-0&#39; came back up; going online.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.750071] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-0: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.750145] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-1: changing port to 49658 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.751171] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.751669] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-1: Connected to Server_Legal_01-client-1, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.751682] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-1: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.871739] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-1: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.872568] I [MSGID: 108031] [afr-common.c:2152:afr_local_discovery_cbk] 0-Server_Legal_01-replicate-0: selecting local read_child Server_Legal_01-client-0</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:44:08.873269] I [MSGID: 104041] [glfs-resolve.c:885:__glfs_active_subvol] 0-Server_Legal_01: switched to graph 63686173-7463-7674-7072-6430342d3335 (0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.343728] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 63686173-7463-7674-7072-6430342d3231 (0) coming up</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.343761] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-0: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.345547] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-1: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.345702] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-0: changing port to 49635 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.346288] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.346666] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-0: Connected to Server_Legal_01-client-0, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.346681] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-0: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.346724] I [MSGID: 108005] [afr-common.c:4382:afr_notify] 0-Server_Legal_01-replicate-0: Subvolume &#39;Server_Legal_01-client-0&#39; came back up; going online.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.346756] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-0: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.346788] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-1: changing port to 49658 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.347909] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.348419] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-1: Connected to Server_Legal_01-client-1, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.348432] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-1: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.528253] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-1: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.529286] I [MSGID: 108031] [afr-common.c:2152:afr_local_discovery_cbk] 0-Server_Legal_01-replicate-0: selecting local read_child Server_Legal_01-client-0</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:04.530379] I [MSGID: 104041] [glfs-resolve.c:885:__glfs_active_subvol] 0-Server_Legal_01: switched to graph 63686173-7463-7674-7072-6430342d3231 (0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:04.941563] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 63686173-7463-7674-7072-6430342d3232 (0) coming up</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:04.941606] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-0: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:04.942498] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-1: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:04.942753] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-0: changing port to 49635 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:04.943498] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:04.943737] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-1: changing port to 49658 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:04.943823] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-0: Connected to Server_Legal_01-client-0, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:04.943848] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-0: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:04.943893] I [MSGID: 108005] [afr-common.c:4382:afr_notify] 0-Server_Legal_01-replicate-0: Subvolume &#39;Server_Legal_01-client-0&#39; came back up; going online.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:04.943914] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-0: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:04.944870] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:04.945439] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-1: Connected to Server_Legal_01-client-1, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:04.945460] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-1: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:05.292434] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-1: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:05.293381] I [MSGID: 108031] [afr-common.c:2152:afr_local_discovery_cbk] 0-Server_Legal_01-replicate-0: selecting local read_child Server_Legal_01-client-0</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:54:05.294255] I [MSGID: 104041] [glfs-resolve.c:885:__glfs_active_subvol] 0-Server_Legal_01: switched to graph 63686173-7463-7674-7072-6430342d3232 (0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chastcvtprd04:/var/log/glusterfs#</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chglbcvtprd04:/var/log/glusterfs# ls -lrt *Server_Legal_01*.log</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">-rw------- 1 root root  240660 Mar 17 20:52 glfsheal-Server_Legal_01.log</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">-rw------- 1 root root 7788358 Mar 17 20:53 data-simpana-Data-Server_Legal_01.log</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chglbcvtprd04:/var/log/glusterfs# tail -100 data-simpana-Data-Server_Legal_01.log</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:48:39.804078] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:48:39.804249] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:48:39.804253] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid 53f03480-7281-48c1-8daf-51cd3099b47f: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:48:39.804716] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:48:39.804900] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9292716/SFILE_CONTAINER_030 (53f03480-7281-48c1-8daf-51cd3099b47f) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:48:39.805156] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9292716/SFILE_CONTAINER_030 (53f03480-7281-48c1-8daf-51cd3099b47f) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:48:39.805185] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f1a94002328, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9292716/SFILE_CONTAINER_030 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:48:39.805224] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 7535988: READ =&gt; -1 gfid=53f03480-7281-48c1-8daf-51cd3099b47f fd=0x7f1a94002328 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:47:45.522943] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid ddc01be9-1c4a-4535-adc3-91a61e326e3e: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ddc01be9-1c4a-4535-adc3-91a61e326e3e. (Possible split-brain)&quot; repeated 3 times between [2017-03-17 19:47:45.520414] and [2017-03-17 19:47:45.523127]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.398208] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e09bffec-f6f4-432f-8f68-ec3520c6f211. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.398446] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.398693] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.398720] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid e09bffec-f6f4-432f-8f68-ec3520c6f211: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.399501] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid e09bffec-f6f4-432f-8f68-ec3520c6f211: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.400061] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.400258] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9292929/SFILE_CONTAINER_044 (e09bffec-f6f4-432f-8f68-ec3520c6f211) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.400507] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9292929/SFILE_CONTAINER_044 (e09bffec-f6f4-432f-8f68-ec3520c6f211) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.400537] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f1a94002328, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9292929/SFILE_CONTAINER_044 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.400585] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 7538116: READ =&gt; -1 gfid=e09bffec-f6f4-432f-8f68-ec3520c6f211 fd=0x7f1a94002328 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]&quot; repeated 3 times between [2017-03-17 19:49:44.398693] and [2017-03-17 19:49:44.401700]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.401709] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid e09bffec-f6f4-432f-8f68-ec3520c6f211: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.402194] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.402372] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9292929/SFILE_CONTAINER_044 (e09bffec-f6f4-432f-8f68-ec3520c6f211) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.402627] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9292929/SFILE_CONTAINER_044 (e09bffec-f6f4-432f-8f68-ec3520c6f211) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.402678] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 7538117: READ =&gt; -1 gfid=e09bffec-f6f4-432f-8f68-ec3520c6f211 fd=0x7f1a94002328 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.402654] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f1a94002328, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9292929/SFILE_CONTAINER_044 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.215179] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e71812cf-725d-4e95-a471-59cf099055e5. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]&quot; repeated 4 times between [2017-03-17 19:49:44.398446] and [2017-03-17 19:50:47.215449]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.215623] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.215659] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid e71812cf-725d-4e95-a471-59cf099055e5: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.215974] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e71812cf-725d-4e95-a471-59cf099055e5. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.216138] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.216339] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.216355] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid e71812cf-725d-4e95-a471-59cf099055e5: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.216802] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.217006] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9293741/SFILE_CONTAINER_005 (e71812cf-725d-4e95-a471-59cf099055e5) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.217221] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9293741/SFILE_CONTAINER_005 (e71812cf-725d-4e95-a471-59cf099055e5) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.217254] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f1a94002440, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9293741/SFILE_CONTAINER_005 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.217298] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 7538180: READ =&gt; -1 gfid=e71812cf-725d-4e95-a471-59cf099055e5 fd=0x7f1a94002440 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.217382] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e71812cf-725d-4e95-a471-59cf099055e5. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.217572] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.217779] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.217799] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid e71812cf-725d-4e95-a471-59cf099055e5: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.217966] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e71812cf-725d-4e95-a471-59cf099055e5. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.218181] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.218389] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.218394] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid e71812cf-725d-4e95-a471-59cf099055e5: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.218842] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.219020] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9293741/SFILE_CONTAINER_005 (e71812cf-725d-4e95-a471-59cf099055e5) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.219200] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9293741/SFILE_CONTAINER_005 (e71812cf-725d-4e95-a471-59cf099055e5) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.219231] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f1a94002440, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9293741/SFILE_CONTAINER_005 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:50:47.219270] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 7538181: READ =&gt; -1 gfid=e71812cf-725d-4e95-a471-59cf099055e5 fd=0x7f1a94002440 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:49:44.401142] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid e09bffec-f6f4-432f-8f68-ec3520c6f211: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e09bffec-f6f4-432f-8f68-ec3520c6f211. (Possible split-brain)&quot; repeated 3 times between [2017-03-17 19:49:44.398208] and [2017-03-17 19:49:44.401301]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.064446] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2532bb1c-6241-4fd0-92df-30059be2be17. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.064691] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.065358] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.065389] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid 2532bb1c-6241-4fd0-92df-30059be2be17: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.066393] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid 2532bb1c-6241-4fd0-92df-30059be2be17: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.066873] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.067147] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9294213/SFILE_CONTAINER_110 (2532bb1c-6241-4fd0-92df-30059be2be17) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.067281] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9294213/SFILE_CONTAINER_110 (2532bb1c-6241-4fd0-92df-30059be2be17) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.067366] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f1a94002440, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9294213/SFILE_CONTAINER_110 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.067416] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 7538199: READ =&gt; -1 gfid=2532bb1c-6241-4fd0-92df-30059be2be17 fd=0x7f1a94002440 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]&quot; repeated 3 times between [2017-03-17 19:51:13.065358] and [2017-03-17 19:51:13.068580]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.068586] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid 2532bb1c-6241-4fd0-92df-30059be2be17: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.069092] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.069276] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9294213/SFILE_CONTAINER_110 (2532bb1c-6241-4fd0-92df-30059be2be17) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.069538] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9294213/SFILE_CONTAINER_110 (2532bb1c-6241-4fd0-92df-30059be2be17) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.069624] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 7538200: READ =&gt; -1 gfid=2532bb1c-6241-4fd0-92df-30059be2be17 fd=0x7f1a94002440 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.069597] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f1a94002440, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9294213/SFILE_CONTAINER_110 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.972489] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5752e22b-5e89-4543-b7d7-da2a22af09df. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]&quot; repeated 4 times between [2017-03-17 19:51:13.064691] and [2017-03-17 19:52:14.972716]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.972967] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.973008] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid 5752e22b-5e89-4543-b7d7-da2a22af09df: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.973861] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5752e22b-5e89-4543-b7d7-da2a22af09df. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.974022] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.974239] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.974263] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid 5752e22b-5e89-4543-b7d7-da2a22af09df: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.974724] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.974893] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9292929/SFILE_CONTAINER_062 (5752e22b-5e89-4543-b7d7-da2a22af09df) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.975112] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9292929/SFILE_CONTAINER_062 (5752e22b-5e89-4543-b7d7-da2a22af09df) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.975146] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f1a940020f8, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9292929/SFILE_CONTAINER_062 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.975192] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 7538225: READ =&gt; -1 gfid=5752e22b-5e89-4543-b7d7-da2a22af09df fd=0x7f1a940020f8 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.975266] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5752e22b-5e89-4543-b7d7-da2a22af09df. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.975463] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.975654] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.975685] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid 5752e22b-5e89-4543-b7d7-da2a22af09df: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.975860] W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5752e22b-5e89-4543-b7d7-da2a22af09df. (Possible split-brain)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.976067] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-1: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.976240] W [MSGID: 114031] [client-rpc-fops.c:1494:client3_3_fstat_cbk] 0-Server_Legal_01-client-0: remote operation failed [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.976248] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing FGETXATTR on gfid 5752e22b-5e89-4543-b7d7-da2a22af09df: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.976742] W [MSGID: 108027] [afr-common.c:2491:afr_discover_done] 0-Server_Legal_01-replicate-0: no read subvols for (null)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.976933] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-1: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9292929/SFILE_CONTAINER_062 (5752e22b-5e89-4543-b7d7-da2a22af09df) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.977122] E [MSGID: 114031] [client-rpc-fops.c:444:client3_3_open_cbk] 0-Server_Legal_01-client-0: remote operation failed. Path: /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9292929/SFILE_CONTAINER_062 (5752e22b-5e89-4543-b7d7-da2a22af09df) [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.977152] E [MSGID: 109089] [dht-helper.c:1297:dht_migration_complete_check_task] 0-Server_Legal_01-dht: failed to open the fd (0x7f1a940020f8, flags=0100000) on file /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9292929/SFILE_CONTAINER_062 @ Server_Legal_01-replicate-0 [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:14.977193] W [fuse-bridge.c:2228:fuse_readv_cbk] 0-glusterfs-fuse: 7538226: READ =&gt; -1 gfid=5752e22b-5e89-4543-b7d7-da2a22af09df fd=0x7f1a940020f8 (Input/output error)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:51:13.067915] E [MSGID: 108008] [afr-read-txn.c:80:afr_read_txn_refresh_done] 0-Server_Legal_01-replicate-0: Failing READ on gfid 2532bb1c-6241-4fd0-92df-30059be2be17: split-brain observed. [Input/output error]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">The message &quot;W [MSGID: 108008] [afr-read-txn.c:238:afr_read_txn] 0-Server_Legal_01-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2532bb1c-6241-4fd0-92df-30059be2be17. (Possible split-brain)&quot; repeated 3 times between [2017-03-17 19:51:13.064446] and [2017-03-17 19:51:13.068212]</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chglbcvtprd04:/var/log/glusterfs#</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chglbcvtprd04:/var/log/glusterfs# tail -100 glfsheal-Server_Legal_01.log</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:02:46.687131] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-0: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:02:46.778952] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-0: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:02:46.779801] I [MSGID: 108031] [afr-common.c:2152:afr_local_discovery_cbk] 0-Server_Legal_01-replicate-0: selecting local read_child Server_Legal_01-client-1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:02:46.780649] I [MSGID: 104041] [glfs-resolve.c:885:__glfs_active_subvol] 0-Server_Legal_01: switched to graph 6368676c-6263-7674-7072-6430342d3334 (0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.450406] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 6368676c-6263-7674-7072-6430342d3139 (0) coming up</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.450442] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-0: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.451271] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-1: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.451783] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-1: changing port to 49658 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.452408] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-0: changing port to 49635 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.453418] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.454094] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-0: Connected to Server_Legal_01-client-0, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.454109] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-0: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.454151] I [MSGID: 108005] [afr-common.c:4382:afr_notify] 0-Server_Legal_01-replicate-0: Subvolume &#39;Server_Legal_01-client-0&#39; came back up; going online.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.454510] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-0: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.459877] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.460109] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-1: Connected to Server_Legal_01-client-1, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.460123] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-1: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.594044] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-1: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.594904] I [MSGID: 108031] [afr-common.c:2152:afr_local_discovery_cbk] 0-Server_Legal_01-replicate-0: selecting local read_child Server_Legal_01-client-1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:12:50.595728] I [MSGID: 104041] [glfs-resolve.c:885:__glfs_active_subvol] 0-Server_Legal_01: switched to graph 6368676c-6263-7674-7072-6430342d3139 (0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.620877] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 6368676c-6263-7674-7072-6430342d3337 (0) coming up</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.620916] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-0: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.621777] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-1: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.622293] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-1: changing port to 49658 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.622741] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.622912] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-0: changing port to 49635 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.622991] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-1: Connected to Server_Legal_01-client-1, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.623011] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-1: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.623057] I [MSGID: 108005] [afr-common.c:4382:afr_notify] 0-Server_Legal_01-replicate-0: Subvolume &#39;Server_Legal_01-client-1&#39; came back up; going online.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.623080] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-1: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.623953] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.625582] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-0: Connected to Server_Legal_01-client-0, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.625599] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-0: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.721866] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-0: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.722617] I [MSGID: 108031] [afr-common.c:2152:afr_local_discovery_cbk] 0-Server_Legal_01-replicate-0: selecting local read_child Server_Legal_01-client-1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:22:39.723187] I [MSGID: 104041] [glfs-resolve.c:885:__glfs_active_subvol] 0-Server_Legal_01: switched to graph 6368676c-6263-7674-7072-6430342d3337 (0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:36.816124] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 6368676c-6263-7674-7072-6430342d3130 (0) coming up</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:36.827326] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-0: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:36.877385] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-1: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:36.877896] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-1: changing port to 49658 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:36.878285] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:36.878345] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-0: changing port to 49635 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:36.878567] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-1: Connected to Server_Legal_01-client-1, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:36.878587] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-1: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:36.878626] I [MSGID: 108005] [afr-common.c:4382:afr_notify] 0-Server_Legal_01-replicate-0: Subvolume &#39;Server_Legal_01-client-1&#39; came back up; going online.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:36.878646] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-1: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:36.879552] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:36.892670] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-0: Connected to Server_Legal_01-client-0, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:36.892690] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-0: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:37.030054] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-0: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:37.030893] I [MSGID: 108031] [afr-common.c:2152:afr_local_discovery_cbk] 0-Server_Legal_01-replicate-0: selecting local read_child Server_Legal_01-client-1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:32:37.031642] I [MSGID: 104041] [glfs-resolve.c:885:__glfs_active_subvol] 0-Server_Legal_01: switched to graph 6368676c-6263-7674-7072-6430342d3130 (0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.185410] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 6368676c-6263-7674-7072-6430342d3339 (0) coming up</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.193109] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-0: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.194028] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-1: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.194544] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-1: changing port to 49658 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.194997] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.195080] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-0: changing port to 49635 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.195233] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-1: Connected to Server_Legal_01-client-1, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.195249] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-1: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.195287] I [MSGID: 108005] [afr-common.c:4382:afr_notify] 0-Server_Legal_01-replicate-0: Subvolume &#39;Server_Legal_01-client-1&#39; came back up; going online.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.195307] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-1: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.196118] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.196576] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-0: Connected to Server_Legal_01-client-0, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.196592] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-0: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.359040] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-0: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.359995] I [MSGID: 108031] [afr-common.c:2152:afr_local_discovery_cbk] 0-Server_Legal_01-replicate-0: selecting local read_child Server_Legal_01-client-1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:42:49.360629] I [MSGID: 104041] [glfs-resolve.c:885:__glfs_active_subvol] 0-Server_Legal_01: switched to graph 6368676c-6263-7674-7072-6430342d3339 (0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:42.886903] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 6368676c-6263-7674-7072-6430342d3439 (0) coming up</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:42.887194] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-0: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:42.888075] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-1: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:42.888592] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-1: changing port to 49658 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:42.888974] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-0: changing port to 49635 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:42.889131] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:42.889475] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-1: Connected to Server_Legal_01-client-1, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:42.889499] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-1: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:42.889542] I [MSGID: 108005] [afr-common.c:4382:afr_notify] 0-Server_Legal_01-replicate-0: Subvolume &#39;Server_Legal_01-client-1&#39; came back up; going online.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:42.889574] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-1: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:42.889891] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:42.896888] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-0: Connected to Server_Legal_01-client-0, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:42.896926] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-0: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:43.024347] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-0: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:43.025326] I [MSGID: 108031] [afr-common.c:2152:afr_local_discovery_cbk] 0-Server_Legal_01-replicate-0: selecting local read_child Server_Legal_01-client-1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 19:52:43.025934] I [MSGID: 104041] [glfs-resolve.c:885:__glfs_active_subvol] 0-Server_Legal_01: switched to graph 6368676c-6263-7674-7072-6430342d3439 (0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.027898] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 6368676c-6263-7674-7072-6430342d3337 (0) coming up</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.028098] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-0: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.029060] I [MSGID: 114020] [client.c:2356:notify] 0-Server_Legal_01-client-1: parent translators are ready, attempting connect on transport</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.029750] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-1: changing port to 49658 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.029976] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-Server_Legal_01-client-0: changing port to 49635 (from 0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.030502] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.030780] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-1: Connected to Server_Legal_01-client-1, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.030801] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-1: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.030841] I [MSGID: 108005] [afr-common.c:4382:afr_notify] 0-Server_Legal_01-replicate-0: Subvolume &#39;Server_Legal_01-client-1&#39; came back up; going online.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.030873] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-1: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.030900] I [MSGID: 114057] [client-handshake.c:1447:select_server_supported_programs] 0-Server_Legal_01-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.031378] I [MSGID: 114046] [client-handshake.c:1223:client_setvolume_cbk] 0-Server_Legal_01-client-0: Connected to Server_Legal_01-client-0, attached to remote volume &#39;/data/glusterfs/Server_Legal/2I-1-32/brick&#39;.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.031392] I [MSGID: 114047] [client-handshake.c:1234:client_setvolume_cbk] 0-Server_Legal_01-client-0: Server and Client lk-version numbers are not same, reopening the fds</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.147618] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-Server_Legal_01-client-0: Server lk version = 1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.148469] I [MSGID: 108031] [afr-common.c:2152:afr_local_discovery_cbk] 0-Server_Legal_01-replicate-0: selecting local read_child Server_Legal_01-client-1</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">[2017-03-17 20:02:39.148990] I [MSGID: 104041] [glfs-resolve.c:885:__glfs_active_subvol] 0-Server_Legal_01: switched to graph 6368676c-6263-7674-7072-6430342d3337 (0)</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">root@chglbcvtprd04:/var/log/glusterfs#</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Healing /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9282627/SFILE_CONTAINER_066 failed: File not in split-brain.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Volume heal failed.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Healing /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9282627/SFILE_CONTAINER_034 failed: File not in split-brain.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Volume heal failed.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Healing /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9293457/SFILE_CONTAINER_021 failed: File not in split-brain.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Volume heal failed.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Healing /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9282627/SFILE_CONTAINER_046 failed: File not in split-brain.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Volume heal failed.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Healing /Server_Legal/CV_MAGNETIC/V_944453/CHUNK_9293559/SFILE_CONTAINER_005 failed: File not in split-brain.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Volume heal failed.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Healing /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9288763/SFILE_CONTAINER_030 failed: File not in split-brain.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Volume heal failed.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Healing /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9282627/SFILE_CONTAINER_014 failed: File not in split-brain.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Volume heal failed.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Healing /Server_Legal/CV_MAGNETIC/V_944456/CHUNK_9288068/SFILE_CONTAINER_004 failed: File not in split-brain.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Volume heal failed.</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"> </p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><br></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><br></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Regards</p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:&quot;times new roman&quot;,serif;color:rgb(0,0,0);font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">Bernhard<br></p></div>