[Gluster-devel] Access by QEMU+libgfapi fails with 'SETVOLUME on remote-host failed: Authentication failed'

[Niels de Vos]

Hi guys,

I've continued a little with adding support for Gluster in CloudStack.  
Starting a VM with qemu-kvm and storage on Gluster through libgfapi 
gives me the following error:

[client-handshake.c:1397:client_setvolume_cbk] 0-primary_gluster-client-0: SETVOLUME on remote-host failed: Authentication failed

qemu-kvm has been started through libvirt, and the errir is in the 
libvirt log for this VM (/var/log/libvirt/qemu/i-2-5-VM.log).

On the server-side, only the brick.log contains something useful (I did 
not enable debugging yet):

[addr.c:143:gf_auth] 0-auth/addr: client is bound to port 43150 which is not privileged
[authenticate.c:239:gf_authenticate] 0-auth: no authentication module is interested in accepting remote-client (null)
[server-handshake.c:586:server_setvolume] 0-primary_gluster-server: Cannot authenticate client from agent.cloudstack.example.com-13760-2013/12/12-17:56:34:263208-primary_gluster-client-0-0 3.5.0qa3

Environment:
- single brick
- in glusterd.vol: option rpc-auth-allow-insecure on
- volume options:
    server.allow-insecure: on
    storage.owner-gid: 36
    storage.owner-uid: 36
- RHEL-6.5
- glusterfs-3.5.0-0.1.qa3.el6.x86_64
- qemu-kvm-0.12.1.2-2.415.el6.x86_64


Does anyone know if this is a known issue, or am I missing 
a configuration directove somewhere?

Thanks for any ideas,
Niels


PS: Contributions and testers are welcome! Patches based CloudStack-4.2 
are on the Gluster Forge: https://forge.gluster.org/cloudstack-gluster