[Gluster-users] Gluster with ZFS

[Alexander Schreiber]

On Thu, Apr 17, 2025 at 09:40:08AM +0530, gagan tiwari wrote:
> Hi Guys,
>                  We have been  using OpenZFS in our HPC environment for
> quite some time. And OpenZFS was going fine.
> 
> But we are now running into scalability issues since OpenZFS can't be
> scaled out.

Since ZFS is a local FS, you are essentially limited to how much storage
you can stick into one machine, yes.
 
> So, I am planning to use Gluster on top of OpenZFS.

I don't think that is giving you the kind of long term scalability
you might expect.

> So, I wanted to know if anyone has tried it. if yes, how it was and any
> deployment guide for it.

I'm running GlusterFS in a small cluster for backup storage.

> We have an HPC environment . Data security and extremely fast read
> performance is very important for us.
> 
> So, please advise.

For that use case I would actually recommend Ceph over GlusterFS, since
that can be pretty easily scaled out to very large setups, e.g. CERN is
using multiple Ceph clusters sized at several PB and their use cases
usually include very fast I/O.

Another concern is that Ceph is being quite actively developed whereas
GlusterFS development seems to have slowed down to ... not much, these days.

Kind regards,
            Alex.
-- 
"Opportunity is missed by most people because it is dressed in overalls and
 looks like work."                                      -- Thomas A. Edison