[Gluster-users] Bareos backup from Gluster mount
André Bauer
abauer at magix.net
Thu Jul 30 07:46:49 UTC 2015
Hi Ryan,
all my Servers are on Ubuntu 14.04 64 Bit.
Bacula version is 5.2.6+dfsg-9.1ubuntu3
Using Gluster 3.5.5 packages from: https://launchpad.net/~gluster
4 Gluster nodes. All volumes are distributed-replicate.
Mounted via fuse or nfs.
Only "problem" i have is poor small file performance while backuping.
Workaround is to mount an image via libgfapi in my vms. This works
faster as fuse / nfs mount.
Regards
André
Am 29.07.2015 um 20:03 schrieb Ryan Clough:
> Can you tell me some information about your setup? I would be interested
> in the OS and version of OS on the Bareos Director, version of Gluster,
> and the version of Bacula that you are using. Also, what type(dist,
> repl) of Gluster cluster? Thank you for taking the time to try to help
> me with this.
>
> ___________________________________________
> ¯\_(ツ)_/¯
> Ryan Clough
> Information Systems
> Decision Sciences International Corporation
> <http://www.decisionsciencescorp.com/><http://www.decisionsciencescorp.com/>
>
> On Wed, Jul 29, 2015 at 10:36 AM, André Bauer <abauer at magix.net
> <mailto:abauer at magix.net>> wrote:
>
> We're using Bacula (Bareos is a fork of it) for backups.
> Never had any problems doing backups of Gluster volumes.
>
> Am 27.07.2015 um 23:02 schrieb Ryan Clough:
> > Hello,
> >
> > I have cross-posted this question in the bareos-users mailing list.
> >
> > Wondering if anyone has tried this because I am unable to backup data
> > that is mounted via Gluster Fuse or Gluster NFS. Basically, I have the
> > Gluster volume mounted on the Bareos Director which also has the tape
> > changer attached.
> >
> > Here is some information about versions:
> > Bareos version 14.2.2
> > Gluster version 3.7.2
> > Scientific Linux version 6.6
> >
> > Our Gluster volume consists of two nodes in distribute only. Here
> is the
> > configuration of our volume:
> > [root at hgluster02 ~]# gluster volume info
> >
> > Volume Name: export_volume
> > Type: Distribute
> > Volume ID: c74cc970-31e2-4924-a244-4c70d958dadb
> > Status: Started
> > Number of Bricks: 2
> > Transport-type: tcp
> > Bricks:
> > Brick1: hgluster01:/gluster_data
> > Brick2: hgluster02:/gluster_data
> > Options Reconfigured:
> > performance.io-thread-count: 24
> > server.event-threads: 20
> > client.event-threads: 4
> > performance.readdir-ahead: on
> > features.inode-quota: on
> > features.quota: on
> > nfs.disable: off
> > auth.allow: 192.168.10.*,10.0.10.*,10.8.0.*,10.2.0.*,10.0.60.*
> > server.allow-insecure: on
> > server.root-squash: on
> > performance.read-ahead: on
> > features.quota-deem-statfs: on
> > diagnostics.brick-log-level: WARNING
> >
> > When I try to backup a directory from Gluster Fuse or Gluster NFS
> mount
> > and I monitor the network communication I only see data being pulled
> > from the hgluster01 brick. When the job finishes Bareos thinks that it
> > completed without error but included in the messages for the job are
> > lots and lots of permission denied errors like this:
> > 15-Jul 02:03 ripper.red.dsic.com-fd JobId 613: Cannot open
> > "/export/rclough/psdv-2014-archives-2/scan_111.tar.bak":
> ERR=Permission
> > denied.
> > 15-Jul 02:03 ripper.red.dsic.com-fd JobId 613: Cannot open
> > "/export/rclough/psdv-2014-archives-2/run_219.tar.bak": ERR=Permission
> > denied.
> > 15-Jul 02:03 ripper.red.dsic.com-fd JobId 613: Cannot open
> > "/export/rclough/psdv-2014-archives-2/scan_112.tar.bak":
> ERR=Permission
> > denied.
> > 15-Jul 02:03 ripper.red.dsic.com-fd JobId 613: Cannot open
> > "/export/rclough/psdv-2014-archives-2/run_220.tar.bak": ERR=Permission
> > denied.
> > 15-Jul 02:03 ripper.red.dsic.com-fd JobId 613: Cannot open
> > "/export/rclough/psdv-2014-archives-2/scan_114.tar.bak":
> ERR=Permission
> > denied.
> >
> > At first I thought this might be a root-squash problem but, if I
> try to
> > read/copy a file using the root user from the Bareos server that is
> > trying to do the backup, I can read files just fine.
> >
> > When the job finishes is reports that it finished "OK -- with
> warnings"
> > but, again the log for the job is filled with "ERR=Permission denied"
> > messages. In my opinion, this job did not finish OK and should be
> > Failed. Some of the files from the HGluster02 brick are backed up but
> > all of the ones with permission errors do not. When I restore the job,
> > all of the files with permission errors are empty.
> >
> > Has anyone successfully used Bareos to backup data from Gluster
> mounts?
> > This is an important use case for us because this is the largest
> single
> > volume that we have to prepare large amounts of data to be archived.
> >
> > Thank you for your time,
> > ___________________________________________
> > ¯\_(ツ)_/¯
> > Ryan Clough
> > Information Systems
> > Decision Sciences International Corporation
> >
> <http://www.decisionsciencescorp.com/><http://www.decisionsciencescorp.com/>
> >
> > This email and its contents are confidential. If you are not the
> > intended recipient, please do not disclose or use the information within
> > this email or its attachments. If you have received this email in error,
> > please report the error to the sender by return email and delete this
> > communication from your records.
> >
> >
> > _______________________________________________
> > Gluster-users mailing list
> > Gluster-users at gluster.org <mailto:Gluster-users at gluster.org>
> > http://www.gluster.org/mailman/listinfo/gluster-users
> >
>
>
> --
> Mit freundlichen Grüßen
> André Bauer
>
> MAGIX Software GmbH
> André Bauer
> Administrator
> August-Bebel-Straße 48
> 01219 Dresden
> GERMANY
>
> tel.: 0351 41884875
> e-mail: abauer at magix.net <mailto:abauer at magix.net>
> abauer at magix.net <mailto:abauer at magix.net> <mailto:Email <mailto:Email>>
> www.magix.com <http://www.magix.com> <http://www.magix.com/>
>
>
> Geschäftsführer | Managing Directors: Dr. Arnd Schröder, Michael Keith
> Amtsgericht | Commercial Register: Berlin Charlottenburg, HRB 127205
>
> Find us on:
>
> <http://www.facebook.com/MAGIX> <http://www.twitter.com/magix_de>
> <http://www.youtube.com/wwwmagixcom> <http://www.magixmagazin.de>
> ----------------------------------------------------------------------
> The information in this email is intended only for the addressee named
> above. Access to this email by anyone else is unauthorized. If you are
> not the intended recipient of this message any disclosure, copying,
> distribution or any action taken in reliance on it is prohibited and
> may be unlawful. MAGIX does not warrant that any attachments are free
> from viruses or other defects and accepts no liability for any losses
> resulting from infected email transmissions. Please note that any
> views expressed in this email may be those of the originator and do
> not necessarily represent the agenda of the company.
> ----------------------------------------------------------------------
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org <mailto:Gluster-users at gluster.org>
> http://www.gluster.org/mailman/listinfo/gluster-users
>
>
>
> This email and its contents are confidential. If you are not the
> intended recipient, please do not disclose or use the information within
> this email or its attachments. If you have received this email in error,
> please report the error to the sender by return email and delete this
> communication from your records.
--
Mit freundlichen Grüßen
André Bauer
MAGIX Software GmbH
André Bauer
Administrator
August-Bebel-Straße 48
01219 Dresden
GERMANY
tel.: 0351 41884875
e-mail: abauer at magix.net
abauer at magix.net <mailto:Email>
www.magix.com <http://www.magix.com/>
Geschäftsführer | Managing Directors: Dr. Arnd Schröder, Michael Keith
Amtsgericht | Commercial Register: Berlin Charlottenburg, HRB 127205
Find us on:
<http://www.facebook.com/MAGIX> <http://www.twitter.com/magix_de>
<http://www.youtube.com/wwwmagixcom> <http://www.magixmagazin.de>
----------------------------------------------------------------------
The information in this email is intended only for the addressee named
above. Access to this email by anyone else is unauthorized. If you are
not the intended recipient of this message any disclosure, copying,
distribution or any action taken in reliance on it is prohibited and
may be unlawful. MAGIX does not warrant that any attachments are free
from viruses or other defects and accepts no liability for any losses
resulting from infected email transmissions. Please note that any
views expressed in this email may be those of the originator and do
not necessarily represent the agenda of the company.
----------------------------------------------------------------------
More information about the Gluster-users
mailing list