[Gluster-users] readv on socket failed (invalid argument)

[Scott Merrill]

On 12/2/14, 12:48 AM, Krishnan Parthasarathi wrote:
> Scott,
> 
> Could you check if there a process is listening on the unix domain socket
> /var/run/3714f2b1aabf9be7087fc323824b74dd.socket?
> 
> ss -x | grep /var/run/3714f2b1aabf9be7087fc323824b74dd.socket

The socket file exists, but nothing appears to be using it:

root at gluster1:PRODUCTION:~> tail -2
/var/log/glusterfs/etc-glusterfs-glusterd.vol.log
[2014-12-02 11:43:34.600536] W [socket.c:611:__socket_rwv] 0-management:
readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed
(Invalid argument)
[2014-12-02 11:43:37.600822] W [socket.c:611:__socket_rwv] 0-management:
readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed
(Invalid argument)
root at gluster1:PRODUCTION:~> ls -lh
/var/run/3714f2b1aabf9be7087fc323824b74dd.socket
srwxr-xr-x 1 root root 0 Dec  1 15:18
/var/run/3714f2b1aabf9be7087fc323824b74dd.socket
root at gluster1:PRODUCTION:~> file
/var/run/3714f2b1aabf9be7087fc323824b74dd.socket
/var/run/3714f2b1aabf9be7087fc323824b74dd.socket: socket
root at gluster1:PRODUCTION:~> ss -x | grep
/var/run/3714f2b1aabf9be7087fc323824b74dd.socket
root at gluster1:PRODUCTION:~>
root at gluster1:PRODUCTION:~> grep
/var/run/3714f2b1aabf9be7087fc323824b74dd.socket
/var/log/glusterfs/etc-glusterfs-glusterd.vol.log | wc -l
61906


The same is true on the other server in this replica pair:

root at gluster2:PRODUCTION:~> tail -2
/var/log/glusterfs/etc-glusterfs-glusterd.vol.log
[2014-12-02 11:44:15.421357] W [socket.c:611:__socket_rwv] 0-management:
readv on /var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket failed
(Invalid argument)
[2014-12-02 11:44:18.421720] W [socket.c:611:__socket_rwv] 0-management:
readv on /var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket failed
(Invalid argument)
root at gluster2:PRODUCTION:~> ls -lh
/var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket
srwxr-xr-x 1 root root 0 Dec  1 15:19
/var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket
root at gluster2:PRODUCTION:~> file
/var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket
/var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket: socket
root at gluster2:PRODUCTION:~> ss -x | grep
/var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket
root at gluster2:PRODUCTION:~>
root at gluster2:PRODUCTION:~> grep
/var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket
/var/log/glusterfs/etc-glusterfs-glusterd.vol.log | wc -l
61774

Thanks,
Scott


> ----- Original Message -----
>> What causes these errors?
>>
>> [2014-12-01 20:22:04.661974] W [socket.c:611:__socket_rwv] 0-management:
>> readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed
>> (Invalid argument)
>> [2014-12-01 20:22:07.662292] W [socket.c:611:__socket_rwv] 0-management:
>> readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed
>> (Invalid argument)
>> [2014-12-01 20:22:10.662612] W [socket.c:611:__socket_rwv] 0-management:
>> readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed
>> (Invalid argument)
>> [2014-12-01 20:22:13.662965] W [socket.c:611:__socket_rwv] 0-management:
>> readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed
>> (Invalid argument)
>> [2014-12-01 20:22:16.663287] W [socket.c:611:__socket_rwv] 0-management:
>> readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed
>> (Invalid argument)
>> [2014-12-01 20:22:19.663602] W [socket.c:611:__socket_rwv] 0-management:
>> readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed
>> (Invalid argument)
>> [2014-12-01 20:22:22.663946] W [socket.c:611:__socket_rwv] 0-management:
>> readv on /var/run/
>>
>> We're getting a lot of these in our logs ever since upgrading to 3.6.1.
>>
>> Is it related to my previous report of stale locks?
>> http://supercolony.gluster.org/pipermail/gluster-users/2014-November/019621.html
>>
>> Or are these two independent problems?
>>
>> Thanks,
>> Scott
>>
>> _______________________________________________
>> Gluster-users mailing list
>> Gluster-users at gluster.org
>> http://supercolony.gluster.org/mailman/listinfo/gluster-users
>>