[Gluster-devel] Can self-heal sleep(200) every file ?

[Norbert]

I want add  sleep(200) at every file healing, it's goal is  to relax  cpu, and  make self-heal consumes lower cpu. is it ok ?


in some directory, I have  one hundred thousand files ,size (300k~600k).


using gluster  3.5.1.


thanks.


Norbert


------------------------------------------------








I hava a  gluster replica 3 volume, there are about  10 clients, and clients has  little file to read or write, but the server  cpu consumption is very hight, about 500%~900% until I turn  cluster.entry-self-heal, cluster.metadata-self-heal, cluster.data-self-heal, cluster.self-heal-daemon off.  following is the log of a brick of the replica volume. [2015-11-03 19:28:33.016724] I [client_t.c:184:gf_client_get] 0-kcr-dist-repl-server: client_uid=localhost.localdomain-105008-2015/11/03-18:28:17:422242-kcr-dist-repl-client-1-0 [2015-11-03 19:28:33.016766] I [server-handshake.c:575:server_setvolume] 0-kcr-dist-repl-server: accepted client from localhost.localdomain-105008-2015/11/03-18:28:17:422242-kcr-dist-repl-client-1-0 (version: 3.5.1) [2015-11-03 19:28:33.019580] I [client_t.c:184:gf_client_get] 0-kcr-dist-repl-server: client_uid=localhost.localdomain-105008-2015/11/03-18:28:17:422242-kcr-dist-repl-client-1-0 [2015-11-03 19:28:33.464996] I [client_t.c:184:gf_client_get] 0-kcr-dist-repl-server: client_uid=localhost.localdomain-4364-2015/11/03-15:25:06:807512-kcr-dist-repl-client-1-0 ..... [2015-11-03 19:30:51.504660] I [server.c:521:server_rpc_notify] 0-kcr-dist-repl-server: disconnecting connectionfrom localhost.localdomain-4364-2015/11/03-15:25:06:807512-kcr-dist-repl-client-1-0 [2015-11-03 19:30:51.504745] I [client_t.c:294:gf_client_put] 0-kcr-dist-repl-server: Shutting down connection localhost.localdomain-4364-2015/11/03-15:25:06:807512-kcr-dist-repl-client-1-0 [2015-11-03 19:32:48.229133] I [client_t.c:184:gf_client_get] 0-kcr-dist-repl-server: client_uid=localhost.localdomain-4470-2015/11/03-19:32:48:53943-kcr-dist-repl-client-1-0 [2015-11-03 19:32:48.229175] I [server-handshake.c:575:server_setvolume] 0-kcr-dist-repl-server: accepted client from localhost.localdomain-4470-2015/11/03-19:32:48:53943-kcr-dist-repl-client-1-0 (version: 3.5.1) [2015-11-03 19:32:48.233469] I [client_t.c:184:gf_client_get] 0-kcr-dist-repl-server: client_uid=localhost.localdomain-4470-2015/11/03-19:32:48:53943-kcr-dist-repl-client-1-0 [2015-11-03 19:37:58.984458] I [client_t.c:184:gf_client_get] 0-kcr-dist-repl-server: client_uid=localhost.localdomain-30443-2015/11/03-19:37:59:347743-kcr-dist-repl-client-1-0 [2015-11-03 19:37:58.984501] I [server-handshake.c:575:server_setvolume] 0-kcr-dist-repl-server: accepted client from localhost.localdomain-30443-2015/11/03-19:37:59:347743-kcr-dist-repl-client-1-0 (version: 3.5.1) [2015-11-03 19:37:58.984910] I [client_t.c:184:gf_client_get] 0-kcr-dist-repl-server: client_uid=localhost.localdomain-30443-2015/11/03-19:37:59:347743-kcr-dist-repl-client-1-0 [2015-11-03 19:46:31.564244] I [client_t.c:184:gf_client_get] 0-kcr-dist-repl-server: client_uid=mailserver15-7968-2015/11/03-19:46:31:973535-kcr-dist-repl-client-1-0 [2015-11-03 19:46:31.564391] I [server-handshake.c:575:server_setvolume] 0-kcr-dist-repl-server: accepted client from mailserver15-7968-2015/11/03-19:46:31:973535-kcr-dist-repl-client-1-0 (version: 3.5.1) [2015-11-03 19:46:31.570121] I [client_t.c:184:gf_client_get] 0-kcr-dist-repl-server: client_uid=mailserver15-7968-2015/11/03-19:46:31:973535-kcr-dist-repl-client-1-0 [2015-11-03 19:54:18.705266] I [server.c:521:server_rpc_notify] 0-kcr-dist-repl-server: disconnecting connectionfrom mailserver15-7968-2015/11/03-19:46:31:973535-kcr-dist-repl-client-1-0 [2015-11-03 19:54:18.705293] I [client_t.c:294:gf_client_put] 0-kcr-dist-repl-server: Shutting down connection mailserver15-7968-2015/11/03-19:46:31:973535-kcr-dist-repl-client-1-0 [2015-11-03 19:54:18.705320] W [entrylk.c:736:pl_entrylk_log_cleanup] 0-kcr-dist-repl-server: releasing lock on 71ff3a55-c15f-42c2-a257-f6e182c532ad held by {client=0xb0a090, pid=-1 lk-owner=dcecf5d2687f0000} [2015-11-03 19:54:18.705334] I [server-helpers.c:290:do_fd_cleanup] 0-kcr-dist-repl-server: fd cleanup on /2 [2015-11-03 19:54:18.724274] E [client_t.c:384:gf_client_unref] (-->/usr/lib64/glusterfs/3.5.1/xlator/features/locks.so(pl_flush_cbk+0xb9) [0x7fda012a7369] (-->/usr/lib64/glusterfs/3.5.1/xlator/performance/io-threads.so(iot_flush_cbk+0xb9) [0x7fda0108ccb9] (-->/usr/lib64/glusterfs/3.5.1/xlator/debug/io-stats.so(io_stats_flush_cbk+0xed) [0x7fda0083420d]))) 0-client_t: client is NULL .... [2015-11-04 00:21:00.765660] E [client_t.c:384:gf_client_unref] (-->/usr/lib64/glusterfs/3.5.1/xlator/features/locks.so(pl_flush_cbk+0xb9) [0x7fda012a7369] (-->/usr/lib64/glusterfs/3.5.1/xlator/performance/io-threads.so(iot_flush_cbk+0xb9) [0x7fda0108ccb9] (-->/usr/lib64/glusterfs/3.5.1/xlator/debug/io-stats.so(io_stats_flush_cbk+0xed) [0x7fda0083420d]))) 0-client_t: client is NULL [2015-11-04 00:21:17.209306] W [server-resolve.c:440:resolve_anonfd_simple] 0-server: inode for the gfid (0f331c8b-77ce-4e05-af6d-d6c2da694597) is not found. anonymous fd creation failed [2015-11-04 00:21:17.209373] W [server-resolve.c:440:resolve_anonfd_simple] 0-server: inode for the gfid (0f331c8b-77ce-4e05-af6d-d6c2da694597) is not found. anonymous fd creation failed [2015-11-04 00:21:17.314340] W [server-resolve.c:440:resolve_anonfd_simple] 0-server: inode for the gfid (0f331c8b-77ce-4e05-af6d-d6c2da694597) is not found. anonymous fd creation failed
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-devel/attachments/20151117/c8c1c667/attachment-0003.html>