[Gluster-users] 3.6.1 and openstack

[Xavier Hernandez]

Hi Pedro,

do you get any specific error ?

 From logs, the only thing I see is a warning about a GFID not being 
available. This can cause troubles, but I'm not sure if this is the problem.

Anyway, version 3.6.2 has some fixes that improve on this. Is it 
possible for you to try the newer version ?

Xavi

On 01/27/2015 11:25 AM, Pedro Serotto wrote:
> Dear all,
> I try the disperse volume on 3 node cluster, but my instances never build.
>
> This is the log:
>
> root at node-1:/var/log/glusterfs# tail -f var-lib-nova-instances.log
> [2015-01-27 10:03:11.510702] I
> [client-handshake.c:1415:select_server_supported_programs]
> 0-nova-vm-client-1: Using Program GlusterFS 3.3, Num (1298437), Version
> (330)
> [2015-01-27 10:03:11.511052] I
> [client-handshake.c:1200:client_setvolume_cbk] 0-nova-vm-client-2:
> Connected to nova-vm-client-2, attached to remote volume '/data/nova'.
> [2015-01-27 10:03:11.511074] I
> [client-handshake.c:1212:client_setvolume_cbk] 0-nova-vm-client-2:
> Server and Client lk-version numbers are not same, reopening the fds
> [2015-01-27 10:03:11.511783] I
> [client-handshake.c:1200:client_setvolume_cbk] 0-nova-vm-client-1:
> Connected to nova-vm-client-1, attached to remote volume '/data/nova'.
> [2015-01-27 10:03:11.511806] I
> [client-handshake.c:1212:client_setvolume_cbk] 0-nova-vm-client-1:
> Server and Client lk-version numbers are not same, reopening the fds
> [2015-01-27 10:03:11.512464] I [ec.c:205:ec_up] 0-nova-vm-disperse-0:
> Going UP
> [2015-01-27 10:03:11.520391] I [fuse-bridge.c:5080:fuse_graph_setup]
> 0-fuse: switched to graph 0
> [2015-01-27 10:03:11.520660] I
> [client-handshake.c:188:client_set_lk_version_cbk] 0-nova-vm-client-1:
> Server lk version = 1
> [2015-01-27 10:03:11.520680] I
> [client-handshake.c:188:client_set_lk_version_cbk] 0-nova-vm-client-2:
> Server lk version = 1
> [2015-01-27 10:03:11.520941] I [fuse-bridge.c:4009:fuse_init]
> 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.22
> kernel 7.17
>
>
>
> ------------>>>> nova boot --flavor 1 --image
> 4f31cf1b-3cff-470e-8533-0792c0e805d5 test-vm
>
>
>
>
> [2015-01-27 10:04:38.002739] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.009403] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.019634] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on
> subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.025431] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on
> subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.029552] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on
> subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.040237] I
> [dht-selfheal.c:1065:dht_selfheal_layout_new_directory] 0-nova-vm-dht:
> chunk size = 0xffffffff / 20458 = 0x33414
> [2015-01-27 10:04:38.040343] I
> [dht-selfheal.c:1103:dht_selfheal_layout_new_directory] 0-nova-vm-dht:
> assigning range size 0xffffc648 to nova-vm-disperse-0
> [2015-01-27 10:04:38.045521] I [MSGID: 109036]
> [dht-common.c:6221:dht_log_new_layout_for_dir_selfheal] 0-nova-vm-dht:
> Setting layout of /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa with
> [Subvol_name: nova-vm-disperse-0, Err: -1 , Start: 0 , Stop: 4294967295 ],
> [2015-01-27 10:04:38.057391] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.062147] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.068511] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/console.log
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.072586] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.076411] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.082613] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.config
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.086569] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.089969] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.093946] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/console.log
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.096379] W [ec-helpers.c:501:ec_loc_prepare]
> 0-nova-vm-disperse-0: GFID not available for inode
> [2015-01-27 10:04:38.123688] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.127440] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.131979] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.136525] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.143846] W [ec-helpers.c:501:ec_loc_prepare]
> 0-nova-vm-disperse-0: GFID not available for inode
> [2015-01-27 10:04:38.159679] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info.tmp
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.162102] W [ec-helpers.c:501:ec_loc_prepare]
> 0-nova-vm-disperse-0: GFID not available for inode
> [2015-01-27 10:04:38.175625] I [dht-rename.c:1344:dht_rename]
> 0-nova-vm-dht: renaming
> /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info.tmp
> (hash=nova-vm-disperse-0/cache=nova-vm-disperse-0) =>
> /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info
> (hash=nova-vm-disperse-0/cache=nova-vm-disperse-0)
>
>   where am I wrong?
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
>