[Gluster-users] Volume Creation - Best Practices

[Jim Kinney]

I use single disks as a physical volume. Each gluster host is identical. As more space is needed for a mount point, a set of disks is added to the logical volume of each host. As my primary need is HA, all of my host nodes are simply replicates.

Prior to this config I had a physical raid6 array of 100TB on each host. Lost 3 drives on the same array out of just bad luck. 2 drives died and while replacing them, the third failed. The subsequent rebuild took months 

By splitting each mount point into separate physical drives, my plan is to lessen rebuild time. Rebuilding a failed 24TB chunk that had 3 drives fail should take less time than another 100+TB rebuild that slows everyone down. I also added a third host node to retain quorum in the event of a failure.

As these are mounts are for independent research groups, they can acquire additional storage by simply buying a triplet of drives. To mitigate drive batch failures, we buy from different vendors and 2 different brands of drives.

On August 24, 2018 5:45:15 PM EDT, Brian Andrus <toomuchit at gmail.com> wrote:
>You can do that, but you could run into issues with the 'shared' 
>remaining space. Any one of the volumes could eat up the space you 
>planned on using in another volume. Not a huge issue, but could bite
>you.
>
>I prefer to use ZFS for the flexibility. I create a RAIDZ pool and then
>
>separate zfs filesystems within that for each brick. I can reserve a 
>specific amount of space in the pool for each brick and that can be 
>modified as well.
>
>It is easy to grow it too. Plus, configured right, zfs does parallel 
>across all the disks, so you get speedup in performance.
>
>Brian Andrus
>
>On 8/24/2018 11:45 AM, Mark Connor wrote:
>> Wondering if there is a best practice for volume creation. I don't
>see 
>> this information in the documentation. For example.
>> I have a 10 node distribute-replicate setup with one large xfs 
>> filesystem mounted on each node.
>>
>> Is it OK for me to have just one xfs filesystem mounted and use 
>> subdirectories for my bricks for multiple volume creation?
>> So I could have, lets say 10 different volumes but each using a 
>> brick as subdir on my single xfs filesystem on each node?
>> In other words multiple bricks on one xfs filesystem per node?
>> I create volumes on the fly and creating new filesystems for each
>node 
>> would be too much work.
>>
>> Your thoughts?
>>
>>
>>
>> _______________________________________________
>> Gluster-users mailing list
>> Gluster-users at gluster.org
>> https://lists.gluster.org/mailman/listinfo/gluster-users

-- 
Sent from my Android device with K-9 Mail. All tyopes are thumb related and reflect authenticity.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20180825/8f449f9e/attachment.html>