[Gluster-devel] Cannot run VMware Virtual Machines on GlusterFS

[Fernando Frediani (Qube)]

Hi Tomaoaki,
Thanks for investigating it.
I believe that behaviour you see on your environment is exactly the same here.

I thought originally it could be something that way ESXi mounts the NFS and also changed a few options on the volume GlusterFS(NFS) but didn't work.
Just out of curiosity and I don't think it would be related to this problem, but previously I've tried using striped+replicated+distributed and I couldn't even browse the Datastore or deploy a machine. With Distributed+Replicated I can store data there, it can see the files, so the issue is only when trying to power it on.

Regards,

Fernando

-----Original Message-----
From: Tomoaki Sato [mailto:tsato at valinux.co.jp] 
Sent: 20 June 2012 02:09
To: Fernando Frediani (Qube)
Cc: 'Rajesh Amaravathi'; 'gluster-devel at nongnu.org'
Subject: Re: [Gluster-devel] Cannot run VMware Virtual Machines on GlusterFS

Fernando

I've tried 'getcwd' on the ESXi host with both the Linux kernel NFS server and the GlusterFS(NFS) as I saw following message in the vmware.log.

  vmx| FILE: File_Cwd: getcwd() failed: No such file or directory
  vmx| Unable to determine absolute path for '.'.
  vmx| Msg_Post: Error
  vmx| [msg.filePosix.getcwd] Unable to retrieve the current working directory: No such file or directory. Check if the directory has been deleted or unmounted.
  vmx| [msg.monitorLoop.createVMFailed] Failed to power on VM----------------------------------------

The Linux kernel NFS server serves an Ext3 on a local disk.
The VMkernel does not fail at getcwd with the Linux kernel NFS server and does fail at getcwd with the GlusterFS(NFS) in my environment.

Tomo

(2012/06/19 17:45), Fernando Frediani (Qube) wrote:
> Hi Rajesh,
>
>
> Yes, they definitely exist. The simple test I've done is deploy a new machine and try to power it On right after.
>
> Browsing the Datastore it shows all the files there, it's just a power On that doesn't work.
>
> So, Tomaso, I believe that on the test you did when you mentioned the Linux kernel NFS server that is directly on the brick folder not on a GlusterFS mounted volume ? I guess it's not possible to export it using the kernel NFS server.
>
> What would take to get it working with the Gluster export ?
>
> Regards,
>
> Fernando
>
> *From:*Rajesh Amaravathi [mailto:rajesh at redhat.com]
> *Sent:* 19 June 2012 07:30
> *To:* Fernando Frediani (Qube)
> *Cc:* gluster-devel at nongnu.org
> *Subject:* Re: [Gluster-devel] Cannot run VMware Virtual Machines on 
> GlusterFS
>
> Hi Fernando,
>
> I see some gfid 00000000000000000000000 on lookup of some files (~12). can you confirm if those files actually exist in the backend (bricks)?
>
> Regards,
> Rajesh Amaravathi,
> Software Engineer, GlusterFS
> RedHat Inc.
>
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> ----------------------------------------------------------------------
> --------
 --
>
> *From: *"Fernando Frediani (Qube)" <fernando.frediani at qubenet.net 
> <mailto:fernando.frediani at qubenet.net>>
> *To: *"gluster-devel at nongnu.org <mailto:gluster-devel at nongnu.org>" 
> <gluster-devel at nongnu.org <mailto:gluster-devel at nongnu.org>>
> *Sent: *Monday, June 18, 2012 5:43:23 PM
> *Subject: *[Gluster-devel] Cannot run VMware Virtual Machines on 
> GlusterFS
>
>
> Hi,
>
> I have been trying to run VMware ESXi VMs on Gluster and was never able to, either with Gluster 3.2 or 3.3. It mounts the NFS, deploy the VM but can't power it on. I suspect it would be something to do with the way Gluster exports NFS.
>
> I have been people reporting that they used it with KVM VMs and normal Linux NFS, but I never saw anyone saying they have used it with VMware.
>
> I have enabled TRACE logging and grabber the logs from the host I mounted the Datastore while trying to power on the VM.
>
> Would someone care to look and confirm if it's a NFS export problem or if the problem is somewhere else ?
>
> Thanks
>
> Regards,
>
> *Fernando Frediani*
>
>
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at nongnu.org <mailto:Gluster-devel at nongnu.org> 
> https://lists.nongnu.org/mailman/listinfo/gluster-devel
>
>
>
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at nongnu.org
> https://lists.nongnu.org/mailman/listinfo/gluster-devel