[Gluster-users] 3.6.1 and openstack

[Pedro Serotto]

Dear all, I try the disperse volume on 3 node cluster, but my instances never build.
This is the log:
root at node-1:/var/log/glusterfs# tail -f var-lib-nova-instances.log [2015-01-27 10:03:11.510702] I [client-handshake.c:1415:select_server_supported_programs] 0-nova-vm-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)[2015-01-27 10:03:11.511052] I [client-handshake.c:1200:client_setvolume_cbk] 0-nova-vm-client-2: Connected to nova-vm-client-2, attached to remote volume '/data/nova'.[2015-01-27 10:03:11.511074] I [client-handshake.c:1212:client_setvolume_cbk] 0-nova-vm-client-2: Server and Client lk-version numbers are not same, reopening the fds[2015-01-27 10:03:11.511783] I [client-handshake.c:1200:client_setvolume_cbk] 0-nova-vm-client-1: Connected to nova-vm-client-1, attached to remote volume '/data/nova'.[2015-01-27 10:03:11.511806] I [client-handshake.c:1212:client_setvolume_cbk] 0-nova-vm-client-1: Server and Client lk-version numbers are not same, reopening the fds[2015-01-27 10:03:11.512464] I [ec.c:205:ec_up] 0-nova-vm-disperse-0: Going UP[2015-01-27 10:03:11.520391] I [fuse-bridge.c:5080:fuse_graph_setup] 0-fuse: switched to graph 0[2015-01-27 10:03:11.520660] I [client-handshake.c:188:client_set_lk_version_cbk] 0-nova-vm-client-1: Server lk version = 1[2015-01-27 10:03:11.520680] I [client-handshake.c:188:client_set_lk_version_cbk] 0-nova-vm-client-2: Server lk version = 1[2015-01-27 10:03:11.520941] I [fuse-bridge.c:4009:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.22 kernel 7.17


------------>>>> nova boot --flavor 1 --image 4f31cf1b-3cff-470e-8533-0792c0e805d5 test-vm



[2015-01-27 10:04:38.002739] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.009403] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.019634] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.025431] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.029552] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.040237] I [dht-selfheal.c:1065:dht_selfheal_layout_new_directory] 0-nova-vm-dht: chunk size = 0xffffffff / 20458 = 0x33414[2015-01-27 10:04:38.040343] I [dht-selfheal.c:1103:dht_selfheal_layout_new_directory] 0-nova-vm-dht: assigning range size 0xffffc648 to nova-vm-disperse-0[2015-01-27 10:04:38.045521] I [MSGID: 109036] [dht-common.c:6221:dht_log_new_layout_for_dir_selfheal] 0-nova-vm-dht: Setting layout of /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa with [Subvol_name: nova-vm-disperse-0, Err: -1 , Start: 0 , Stop: 4294967295 ], [2015-01-27 10:04:38.057391] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.062147] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.068511] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/console.log missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.072586] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.076411] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.082613] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.config missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.086569] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.089969] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.093946] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/console.log missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.096379] W [ec-helpers.c:501:ec_loc_prepare] 0-nova-vm-disperse-0: GFID not available for inode[2015-01-27 10:04:38.123688] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.127440] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.131979] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.136525] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.143846] W [ec-helpers.c:501:ec_loc_prepare] 0-nova-vm-disperse-0: GFID not available for inode[2015-01-27 10:04:38.159679] I [dht-common.c:1822:dht_lookup_cbk] 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info.tmp missing on subvol nova-vm-disperse-0[2015-01-27 10:04:38.162102] W [ec-helpers.c:501:ec_loc_prepare] 0-nova-vm-disperse-0: GFID not available for inode[2015-01-27 10:04:38.175625] I [dht-rename.c:1344:dht_rename] 0-nova-vm-dht: renaming /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info.tmp (hash=nova-vm-disperse-0/cache=nova-vm-disperse-0) => /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info (hash=nova-vm-disperse-0/cache=nova-vm-disperse-0)
 where am I wrong? 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150127/bd134538/attachment.html>