[Gluster-users] posix_handle_hard [file exists]
Jorick Astrego
jorick at netbulae.eu
Mon Nov 5 15:00:44 UTC 2018
I see a lot of DHT warnings in
rhev-data-center-mnt-glusterSD-192.168.99.14:_hdd2.log:
[2018-10-21 01:24:01.413126] I
[glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in
volfile, continuing
[2018-11-01 12:48:32.537621] I [MSGID: 109066]
[dht-rename.c:1569:dht_rename] 0-hdd2-dht: renaming
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/b48f6dcc-8fbc-4eb2-bb8b-7a3e03e72899/73655cd8-adfc-404a-8ef7-7bbaee9d43d0.meta.new
(hash=hdd2-replicate-0/cache=hdd2-replicate-0) =>
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/b48f6dcc-8fbc-4eb2-bb8b-7a3e03e72899/73655cd8-adfc-404a-8ef7-7bbaee9d43d0.meta
(hash=hdd2-replicate-0/cache=<nul>)
[2018-11-01 13:31:17.726431] I [MSGID: 109066]
[dht-rename.c:1569:dht_rename] 0-hdd2-dht: renaming
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/f43f4dbd-14ca-49fb-98da-cb32c26b05b7/16ac297a-14e1-43d3-a4d9-f2b8d183c1e1.meta.new
(hash=hdd2-replicate-0/cache=hdd2-replicate-0) =>
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/f43f4dbd-14ca-49fb-98da-cb32c26b05b7/16ac297a-14e1-43d3-a4d9-f2b8d183c1e1.meta
(hash=hdd2-replicate-0/cache=hdd2-replicate-0)
[2018-11-01 13:31:18.316010] I [MSGID: 109066]
[dht-rename.c:1569:dht_rename] 0-hdd2-dht: renaming
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/72bcb410-b20e-45f2-a269-a73e14c550cf/b0cbc7df-2761-4b74-8ca2-ee311fd57bd3.meta.new
(hash=hdd2-replicate-0/cache=hdd2-replicate-0) =>
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/72bcb410-b20e-45f2-a269-a73e14c550cf/b0cbc7df-2761-4b74-8ca2-ee311fd57bd3.meta
(hash=hdd2-replicate-0/cache=hdd2-replicate-0)
[2018-11-01 13:31:18.208882] I [MSGID: 109066]
[dht-rename.c:1569:dht_rename] 0-hdd2-dht: renaming
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/f43f4dbd-14ca-49fb-98da-cb32c26b05b7/16ac297a-14e1-43d3-a4d9-f2b8d183c1e1.meta.new
(hash=hdd2-replicate-0/cache=hdd2-replicate-0) =>
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/f43f4dbd-14ca-49fb-98da-cb32c26b05b7/16ac297a-14e1-43d3-a4d9-f2b8d183c1e1.meta
(hash=hdd2-replicate-0/cache=hdd2-replicate-0)
[2018-11-01 13:31:19.461991] I [MSGID: 109066]
[dht-rename.c:1569:dht_rename] 0-hdd2-dht: renaming
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/72bcb410-b20e-45f2-a269-a73e14c550cf/b0cbc7df-2761-4b74-8ca2-ee311fd57bd3.meta.new
(hash=hdd2-replicate-0/cache=hdd2-replicate-0) =>
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/72bcb410-b20e-45f2-a269-a73e14c550cf/b0cbc7df-2761-4b74-8ca2-ee311fd57bd3.meta
(hash=hdd2-replicate-0/cache=hdd2-replicate-0)
[2018-11-02 13:31:46.567693] I [MSGID: 109066]
[dht-rename.c:1569:dht_rename] 0-hdd2-dht: renaming
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/f43f4dbd-14ca-49fb-98da-cb32c26b05b7/16ac297a-14e1-43d3-a4d9-f2b8d183c1e1.meta.new
(hash=hdd2-replicate-0/cache=hdd2-replicate-0) =>
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/f43f4dbd-14ca-49fb-98da-cb32c26b05b7/16ac297a-14e1-43d3-a4d9-f2b8d183c1e1.meta
(hash=hdd2-replicate-0/cache=hdd2-replicate-0)
[2018-11-02 13:31:47.591958] I [MSGID: 109066]
[dht-rename.c:1569:dht_rename] 0-hdd2-dht: renaming
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/72bcb410-b20e-45f2-a269-a73e14c550cf/b0cbc7df-2761-4b74-8ca2-ee311fd57bd3.meta.new
(hash=hdd2-replicate-0/cache=hdd2-replicate-0) =>
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/72bcb410-b20e-45f2-a269-a73e14c550cf/b0cbc7df-2761-4b74-8ca2-ee311fd57bd3.meta
(hash=hdd2-replicate-0/cache=hdd2-replicate-0)
[2018-11-02 13:31:47.365589] I [MSGID: 109066]
[dht-rename.c:1569:dht_rename] 0-hdd2-dht: renaming
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/f43f4dbd-14ca-49fb-98da-cb32c26b05b7/16ac297a-14e1-43d3-a4d9-f2b8d183c1e1.meta.new
(hash=hdd2-replicate-0/cache=hdd2-replicate-0) =>
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/f43f4dbd-14ca-49fb-98da-cb32c26b05b7/16ac297a-14e1-43d3-a4d9-f2b8d183c1e1.meta
(hash=hdd2-replicate-0/cache=hdd2-replicate-0)
[2018-11-02 13:31:48.095968] I [MSGID: 109066]
[dht-rename.c:1569:dht_rename] 0-hdd2-dht: renaming
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/72bcb410-b20e-45f2-a269-a73e14c550cf/b0cbc7df-2761-4b74-8ca2-ee311fd57bd3.meta.new
(hash=hdd2-replicate-0/cache=hdd2-replicate-0) =>
/5a75dd72-2ab6-457d-b357-6d14b3bc2c3e/images/72bcb410-b20e-45f2-a269-a73e14c550cf/b0cbc7df-2761-4b74-8ca2-ee311fd57bd3.meta
(hash=hdd2-replicate-0/cache=hdd2-replicate-0)
On 11/05/2018 03:53 PM, Jorick Astrego wrote:
>
> Hi Krutika,
>
> Thanks for the info.
>
> After a long time the preallocated disk has been created properly. It
> was a 1TB disk on a hdd pool so a bit of delay was expected.
>
> But it took a bit longer then expected. The disk had no other virtual
> disks on it. Is there something I can tweak or check for this?
>
> Regards, Jorick
>
>
> On 10/31/2018 01:10 PM, Krutika Dhananjay wrote:
>> These log messages represent a transient state and are harmless and
>> can be ignored. This happens when a lookup and mknod to create shards
>> happen in parallel.
>>
>> Regarding the preallocated disk creation issue, could you check if
>> there are any errors/warnings in the fuse mount logs (these are named
>> as the hyphenated mountpoint name followed by a ".log" and are found
>> under /var/log/glusterfs).
>>
>> -Krutika
>>
>>
>> On Wed, Oct 31, 2018 at 4:58 PM Jorick Astrego <jorick at netbulae.eu
>> <mailto:jorick at netbulae.eu>> wrote:
>>
>> Hi,
>>
>> I have the similar issues with ovirt 4.2 on a glusterfs-3.8.15
>> cluster. This was a new volume and I created first a thin
>> provisioned disk, then I tried to create a preallocated disk but
>> it hangs after 4MB. The only issue I can find in the logs sofar
>> are the [File exists] errors with the sharding.
>>
>>
>> The message "W [MSGID: 113096]
>> [posix-handle.c:761:posix_handle_hard] 0-hdd2-posix: link
>> /data/hdd2/brick1/.shard/6573a019-dba5-4f97-bca9-0a00ce537318.125365
>> ->
>> /data/hdd2/brick1/.glusterfs/16/a1/16a18a01-4f77-4c37-923d-9f0bc59f5cc7failed
>> [File exists]" repeated 2 times between [2018-10-31
>> 10:46:33.810987] and [2018-10-31 10:46:33.810988]
>> [2018-10-31 10:46:33.970949] W [MSGID: 113096]
>> [posix-handle.c:761:posix_handle_hard] 0-hdd2-posix: link
>> /data/hdd2/brick1/.shard/6573a019-dba5-4f97-bca9-0a00ce537318.125366
>> ->
>> /data/hdd2/brick1/.glusterfs/90/85/9085ea11-4089-4d10-8848-fa2d518fd86dfailed
>> [File exists]
>> [2018-10-31 10:46:33.970950] W [MSGID: 113096]
>> [posix-handle.c:761:posix_handle_hard] 0-hdd2-posix: link
>> /data/hdd2/brick1/.shard/6573a019-dba5-4f97-bca9-0a00ce537318.125366
>> ->
>> /data/hdd2/brick1/.glusterfs/90/85/9085ea11-4089-4d10-8848-fa2d518fd86dfailed
>> [File exists]
>> [2018-10-31 10:46:35.601064] W [MSGID: 113096]
>> [posix-handle.c:761:posix_handle_hard] 0-hdd2-posix: link
>> /data/hdd2/brick1/.shard/6573a019-dba5-4f97-bca9-0a00ce537318.125369
>> ->
>> /data/hdd2/brick1/.glusterfs/9b/eb/9bebaaac-f460-496f-b30d-aabe77bffbc8failed
>> [File exists]
>> [2018-10-31 10:46:35.601065] W [MSGID: 113096]
>> [posix-handle.c:761:posix_handle_hard] 0-hdd2-posix: link
>> /data/hdd2/brick1/.shard/6573a019-dba5-4f97-bca9-0a00ce537318.125369
>> ->
>> /data/hdd2/brick1/.glusterfs/9b/eb/9bebaaac-f460-496f-b30d-aabe77bffbc8failed
>> [File exists]
>> [2018-10-31 10:46:36.040564] W [MSGID: 113096]
>> [posix-handle.c:761:posix_handle_hard] 0-hdd2-posix: link
>> /data/hdd2/brick1/.shard/6573a019-dba5-4f97-bca9-0a00ce537318.125370
>> ->
>> /data/hdd2/brick1/.glusterfs/30/93/3093fdb6-e62c-48b8-90e7-d4d72036fb69failed
>> [File exists]
>> [2018-10-31 10:46:36.040565] W [MSGID: 113096]
>> [posix-handle.c:761:posix_handle_hard] 0-hdd2-posix: link
>> /data/hdd2/brick1/.shard/6573a019-dba5-4f97-bca9-0a00ce537318.125370
>> ->
>> /data/hdd2/brick1/.glusterfs/30/93/3093fdb6-e62c-48b8-90e7-d4d72036fb69failed
>> [File exists]
>> [2018-10-31 10:46:36.319247] W [MSGID: 113096]
>> [posix-handle.c:761:posix_handle_hard] 0-hdd2-posix: link
>> /data/hdd2/brick1/.shard/6573a019-dba5-4f97-bca9-0a00ce537318.125372
>> ->
>> /data/hdd2/brick1/.glusterfs/c3/c2/c3c272f5-50af-4e82-94bb-b76eaa7a9a39failed
>> [File exists]
>> [2018-10-31 10:46:36.319250] W [MSGID: 113096]
>> [posix-handle.c:761:posix_handle_hard] 0-hdd2-posix: link
>> /data/hdd2/brick1/.shard/6573a019-dba5-4f97-bca9-0a00ce537318.125372
>> ->
>> /data/hdd2/brick1/.glusterfs/c3/c2/c3c272f5-50af-4e82-94bb-b76eaa7a9a39failed
>> [File exists]
>> [2018-10-31 10:46:36.319309] E [MSGID: 113020]
>> [posix.c:1407:posix_mknod] 0-hdd2-posix: setting gfid on
>> /data/hdd2/brick1/.shard/6573a019-dba5-4f97-bca9-0a00ce537318.125372
>> failed
>>
>>
>> -rw-rw----. 2 root root 4194304 Oct 31 11:46
>> /data/hdd2/brick1/.shard/6573a019-dba5-4f97-bca9-0a00ce537318.125366
>>
>> -rw-rw----. 2 root root 4194304 Oct 31 11:46
>> /data/hdd2/brick1/.glusterfs/9b/eb/9bebaaac-f460-496f-b30d-aabe77bffbc8
>>
>> On 10/01/2018 12:36 PM, Jose V. Carrión wrote:
>>>
>>> Hi,
>>>
>>> I have a gluster 3.12.6-1 installation with 2 configured volumes.
>>>
>>> Several times at day , some bricks are reporting the lines below:
>>>
>>> [2018-09-30 20:36:27.348015] W [MSGID: 113096]
>>> [posix-handle.c:770:posix_handle_hard] 0-volumedisk0-posix: link
>>> /mnt/glusterfs/vol0/brick1/6349/20180921/20180921.h5 ->
>>> /mnt/glusterfs/vol0/brick1/.glusterfs/3b/1c/3b1c5fe1-b141-4687-8eaf-2c28f9505277failed
>>> [File exists]
>>> [2018-09-30 20:36:27.383957] E [MSGID: 113020]
>>> [posix.c:3162:posix_create] 0-volumedisk0-posix: setting gfid on
>>> /mnt/glusterfs/vol0/brick1/6349/20180921/20180921.h5 failed
>>>
>>> I can access to the
>>> /mnt/glusterfs/vol0/brick1/6349/20180921/20180921.h5 and
>>> /mnt/glusterfs/vol0/brick1/.glusterfs/3b/1c/3b1c5fe1-b141-4687-8eaf-2c28f9505277,
>>> both files are hard links .
>>>
>>> What is the meaning of the error lines?
>>>
>>> Thanks in advance.
>>>
>>> Cheers.
>>>
>>>
>>>
>>> _______________________________________________
>>> Gluster-users mailing list
>>> Gluster-users at gluster.org <mailto:Gluster-users at gluster.org>
>>> https://lists.gluster.org/mailman/listinfo/gluster-users
>>
>>
>>
>>
>>
>> Met vriendelijke groet, With kind regards,
>>
>> Jorick Astrego
>> *
>> Netbulae Virtualization Experts *
>> ------------------------------------------------------------------------
>> Tel: 053 20 30 270 info at netbulae.eu <mailto:info at netbulae.eu>
>> Staalsteden 4-3A KvK 08198180
>> Fax: 053 20 30 271 www.netbulae.eu <http://www.netbulae.eu>
>> 7547 TA Enschede BTW NL821234584B01
>>
>>
>> ------------------------------------------------------------------------
>>
>> _______________________________________________
>> Gluster-users mailing list
>> Gluster-users at gluster.org <mailto:Gluster-users at gluster.org>
>> https://lists.gluster.org/mailman/listinfo/gluster-users
>>
>
Met vriendelijke groet, With kind regards,
Jorick Astrego
Netbulae Virtualization Experts
----------------
Tel: 053 20 30 270 info at netbulae.eu Staalsteden 4-3A KvK 08198180
Fax: 053 20 30 271 www.netbulae.eu 7547 TA Enschede BTW NL821234584B01
----------------
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20181105/cd7fc618/attachment.html>
More information about the Gluster-users
mailing list