[Gluster-users] [Bug 1057645] ownership of diskimage changes during livemigration, livemigration with kvm/libvirt fails

Tue Feb 18 21:31:24 UTC 2014

I've yet to crack into 14.04 and see what that beast looks like as we don't have it in use here yet. I'll add that to my todo list. I can be bribed if someone needs it sooner :) 

As a separate task, I'll look into the ipxe problem. I remember it was file conflict between the packages so I may have to do some hacks in the debian build rules for one of the packages. 

The PPA is an option but yes maintenance would be ongoing and best effort as that's all I can afford currently. 

----- Original Message -----

From: "bernhard glomm" <bernhard.glomm at ecologic.eu> 
To: "Paul Boven" <boven at jive.nl>, gluster-devel at nongnu.org 
Cc: "Josh Boon" <gluster at joshboon.com>, "gluster-users at gluster.org List" <gluster-users at gluster.org> 
Sent: Tuesday, February 18, 2014 4:23:53 PM 
Subject: Re: [Gluster-users] [Bug 1057645] ownership of diskimage changes during livemigration, livemigration with kvm/libvirt fails 

Hi Paul, and all 

With the release of Ubuntu 14.04 LTS, I hope to be able to use libgfapi on our setup. 

Well I hope that too, but I'm not sure if that will happen (soon). 
I , recompiled qemu as described here: 

http://www.gluster.org/community/documentation/index.php/Building_QEMU_with_gfapi_for_Debian_based_systems 

with little luck since finally the ipxe-qemu component (which I need/want) 
and I didn't had the time to dig deeper into that. 

https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1224517 

still says "won't fix it" :-( 

Josh Boon (hi Josh) suggested to create a PPA for an ubuntu qemu with gfapi support 
which might be a temporary solution … 
But from my "happy end - user" perspective (as a "non-dev-but-op") 
that looks like a lot of parallel extra work 
on maintaining that "fork"in the long run. 
I hope the gluster devels either can get it into debian(and/or ubuntu) 
or even qemu (as a default option?) directly 

<blockquote>
Perhaps the fact that the RedHat specific bug is now private might mean that they're actually doing something with it, but I wouldn't know. 

</blockquote>

we'll stay on that topic 

Regards, 
Bernahrd 

<blockquote>
Regards, Paul Boven. 

</blockquote>

<blockquote>

On 02/18/2014 02:59 PM, Adam Huffman wrote: 

<blockquote>
Hi Paul, 

Could you keep the list updated? That bug has been marked private, so 
I can't see it. 

Best Wishes, 
Adam 

On Tue, Jan 28, 2014 at 9:29 AM, Paul Boven < boven at jive.nl > wrote: 

<blockquote>
Hi Bernhard, everyone, 

The same problem has now been reproduced on RedHat, please see: 

https://bugzilla.redhat.com/show_bug.cgi?id=1058032 

With 3.4.0 and Ubuntu 13.04, live migrations worked fine. For me it broke 
when the packages were upgraded to 3.4.1. 

I've set AppArmor to 'complain' as part of the debugging, so that's not the 
issue. 

I'm still not convinced that the file ownership itself is the root cause of 
this issue, it could well be just a symptom. Libvirt/qemu is perfectly happy 
to start a VM when its image file is owned root:root, and change ownership 
to libvirt-qemu:kvm. So I see no reason why it couldn't do the same during a 
live migration. 

In my opinion the real issue is the failure at the fuse level, that makes 
file access to the image on the destination impossible, even for root. 

Regards, Paul Boven. 

On 01/27/2014 07:51 PM, BGM wrote: 

<blockquote>

Hi Paul & all 
I'm really keen on getting this solved, 
right now it's a nasty show stopper. 
I could try different gluster versions, 
as long as I can get the .debs for it, 
wouldn't want to start compiling 
(although.... does a config option have changed on package build?) 
you reported that 3.4.0 on ubuntu 13.04 was working, right? 
code diff, config options for package build. 
Another approach: can anyone verify or falsify 
https://bugzilla.redhat.com/show_bug.cgi?id=1057645 
on another distro than ubuntu/debian? 
thinking of it... could it be an apparmor interference? 
I had fun with apparmor and mysql on ubuntu 12.04 once... 
will have a look at that tomorrow. 
As mentioned before, a straight drbd/ocfs2 works (with only 1/4 speed 
and the pain of maintenance) so AFAIK I have to blame the ownership change 
on gluster, not on an issue with my general setup.... 
best regards 
Bernhard 

</blockquote>

-- 
Paul Boven <boven at jive.nl> +31 (0)521-596547 
Unix/Linux/Networking specialist 
Joint Institute for VLBI in Europe - www.jive.nl 
VLBI - It's a fringe science 
_______________________________________________ 
Gluster-users mailing list 
Gluster-users at gluster.org 
http://supercolony.gluster.org/mailman/listinfo/gluster-users 

</blockquote>
_______________________________________________ 
Gluster-users mailing list 
Gluster-users at gluster.org 
http://supercolony.gluster.org/mailman/listinfo/gluster-users 

</blockquote>

-- 
Paul Boven < boven at jive.nl > +31 (0)521-596547 
Unix/Linux/Networking specialist 
Joint Institute for VLBI in Europe - www.jive.nl 
VLBI - It's a fringe science 
_______________________________________________ 
Gluster-users mailing list 
Gluster-users at gluster.org 
http://supercolony.gluster.org/mailman/listinfo/gluster-users 

</blockquote>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20140218/2839804c/attachment.html>