[Bugs] [Bug 1569074] fatal: unable to access file: Stale file handle

[bugzilla at redhat.com]

https://bugzilla.redhat.com/show_bug.cgi?id=1569074



--- Comment #1 from g.amedick at uni-luebeck.de ---
Hi,

according to our users, this affects exclusively git projects. Today, I found
something interesting in the logs of our rebalances. They contain the following
lines (the path varies):


[2018-04-25 16:44:45.443553] E [MSGID: 109023]
[dht-rebalance.c:2669:gf_defrag_migrate_single_file] 0-$vol-dht: Migrate file
failed: /$somepath/.git/config lookup failed [Stale file handle]
[2018-06-19 22:50:55.621752] I [dht-rebalance.c:3437:gf_defrag_process_dir]
0-$vol-dht: Migration operation on dir /$somepath/.git took 0.03 secs

Side note: this does not count as a failure in the rebalance status. Not sure
whether this is intended or not, since it is classified as an error. 

The paths varies, but it's always something in a .git-folder. Mostly the
config, sometimes other files in a .git folder.

This goes back until February. The logs before February contain messages like
this:

[2017-12-15 23:53:02.919615] W [MSGID: 109023]
[dht-rebalance.c:2503:gf_defrag_get_entry] 0-$vol-dht: lookup failed for
file:/$somepath/.git/config [Stale file handle]
[2018-06-19 22:50:55.621752] I [dht-rebalance.c:3437:gf_defrag_process_dir]
0-$vol-dht: Migration operation on dir /$somepath/.git took 0.03 secs

Similar but different. In February, we migrated from 3.8 to 3.12, so perhapes
the versions treated the same thing slightly differently.

Searching in the rebalance log for one of those files showed the following (for
both before and after the upgrade to 3.12):

$ zgrep "$somepath/.git/config" $vol-rebalance.log.5
[2018-05-01 12:01:00.633768] W [MSGID: 109009]
[dht-common.c:2210:dht_lookup_linkfile_cbk] 0-$vol-dht: /$somepath/.git/config:
gfid different on data file on $vol-client-22, gfid local =
f61909e4-cfbf-4802-af00-70ffb9e79d28, gfid node =
f61909e4-cfbf-4802-af00-70ffb9e79d28 
[2018-05-01 12:01:00.634506] W [MSGID: 109009]
[dht-common.c:1949:dht_lookup_everywhere_cbk] 0-$vol-dht:
/$somepath/.git/config: gfid differs on subvolume $vol-client-22, gfid local =
070f37a1-de0c-439b-97dd-ce5311988737, gfid node =
f61909e4-cfbf-4802-af00-70ffb9e79d28
[2018-05-01 12:01:00.645447] E [MSGID: 109023]
[dht-rebalance.c:2669:gf_defrag_migrate_single_file] 0-$vol-dht: Migrate file
failed: /$somepath/.git/config lookup failed [Stale file handle]


It looks like the files have two different gfid's somehow.
dht_lookup_linkfile_cbk actually reports identical gfid's, but
dht_lookup_everywhere_cbk finds two different ones.

Could that be the reason for the stale files handles? And if yes, why does this
happen (and why only to .git-files) and how can I fix that?

-- 
You are receiving this mail because:
You are on the CC list for the bug.
You are the assignee for the bug.