[Gluster-users] gluster no longer serving all of its files

[Pat Haley]

Hi All,

We have just got gluster-3.1.4 again.  When we upgraded
to 3.2.5 the .vol files in /etc/glusterd/vols/... had
new features (specifically "type features/marker") that
version 3.1.4 was not happy with.

Still not certain why version 3.2.5 wasn't working.
One other thing we changed was restarting on of
the ethernet ports on the brick that was causing
the trouble (it didn't solve the issue, but we
never tried version 3.2.5 after restarting the port).

> Hi Pat,
> 
> I've seen a similar issue, when using the NFS translator, some files
> were not visible (hundreds of thousands to millions of files in the
> XFS filesystem); but native client systems could see all files.
> 
> This was with a single brick system, I had to revert that system to
> old NFS (no gluster) to resolve the issue, as some of my systems can
> only NFS mount.
> 
> Hope this helps...
> 
> --Tom
> 
> On Tue, Jan 31, 2012 at 10:44 AM, Pat Haley <phaley at mit.edu> wrote:
>> Hi Pranith,
>>
>> In the logs, the problem brick is 0-gdata-client-2.
>> I've put the log files in
>>
>> http://mseas.mit.edu/download/phaley/GlusterUsers/
>>
>> Thanks,
>>
>>
>>> hi Pat,
>>>     Could you give us the volume info output. Please attach the client
>>> node logs. Let us know which brick is giving problems in your volume info
>>> output.
>>>
>>> Pranith
>>> On 01/30/2012 11:47 PM, Pat Haley wrote:
>>>>
>>>> Hi,
>>>>
>>>> We recently upgraded our version of gluster from 3.1.4 to
>>>> 3.2.5. Shortly after I noticed that gluster was not serving
>>>> up all of its files, that is if I log onto one of the individual
>>>> bricks and do an ls of the underlying nfs directories, I can
>>>> see files that I do not see if do an ls from a client node
>>>> in the equivalent gluster directory.
>>>>
>>>> We may have caused this by also running a script that went
>>>> through and removed pointer files (this had been how we had
>>>> been dealing with bad pointers under gluster 3.1.4).
>>>>
>>>> So far, we have tried
>>>>   - running a gluster self-heal under version 3.2.5
>>>>   - rolling back to version 3.1.4
>>>>   - running a gluster self-heal under version 3.1.4
>>>>   - running a rebalance under version 3.1.4
>>>> None of these have solved the problem.  The one other
>>>> piece of data we have is that all the files which are
>>>> not being served appear to reside on a single brick
>>>> (at least every file we missed so far has been on
>>>>  that server and we have not found one missing from
>>>>  the other servers).
>>>>
>>>> Any advice you can give us would be greatly appreciated.
>>>>
>>>> -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
>>>> Pat Haley                          Email:  phaley at mit.edu
>>>> Center for Ocean Engineering       Phone:  (617) 253-6824
>>>> Dept. of Mechanical Engineering    Fax:    (617) 253-8125
>>>> MIT, Room 5-222B                   http://web.mit.edu/phaley/www/
>>>> 77 Massachusetts Avenue
>>>> Cambridge, MA  02139-4301
>>>> _______________________________________________
>>>> Gluster-users mailing list
>>>> Gluster-users at gluster.org
>>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>>
>>> _______________________________________________
>>> Gluster-users mailing list
>>> Gluster-users at gluster.org
>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>
>>
>> --
>>
>> -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
>> Pat Haley                          Email:  phaley at mit.edu
>> Center for Ocean Engineering       Phone:  (617) 253-6824
>> Dept. of Mechanical Engineering    Fax:    (617) 253-8125
>> MIT, Room 5-222B                   http://web.mit.edu/phaley/www/
>> 77 Massachusetts Avenue
>> Cambridge, MA  02139-4301
>> _______________________________________________
>> Gluster-users mailing list
>> Gluster-users at gluster.org
>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
> 
> 
> 


-- 

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Pat Haley                          Email:  phaley at mit.edu
Center for Ocean Engineering       Phone:  (617) 253-6824
Dept. of Mechanical Engineering    Fax:    (617) 253-8125
MIT, Room 5-222B                   http://web.mit.edu/phaley/www/
77 Massachusetts Avenue
Cambridge, MA  02139-4301