[Gluster-users] >1PB

[Joe Landman]

On 02/06/2012 01:41 PM, Andrew Holway wrote:
> Hi,
>
> Can anyone tell me about their experiences with 1PB and larger gluster
> installations. We are thinking of doing 1PB with 10x 100PB storage
> servers and would appreciate some reassurance :). We plan to scale
> to....above and beyond....

Greetings Andrew:

   We've got a bit of experience in scaling to (many large) bricks for 
gluster.  The big issues are reliable/working network connections, 
RAIDs, etc.  Currently you should look carefully at some sort of 
replication mechanism (if you are storing 1PB of data, recovery time is 
likely important).

   100TB bricks aren't a problem (as long as they are built sanely), 
though I'd probably suggest subdividing smaller so you can take better 
advantage of finer grain parallelism.  The issue on design of the bricks 
goes to the bandwidth and the height of the storage bandwidth wall (time 
required to read/write the entire 100TB).  For most designs we see 
(cascading arrays with SAS/FC), this is going to be problematic at best. 
  But thats another story (and we are biased because of what we do).




-- 
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics Inc.
email: landman at scalableinformatics.com
web  : http://scalableinformatics.com
        http://scalableinformatics.com/sicluster
phone: +1 734 786 8423 x121
fax  : +1 866 888 3112
cell : +1 734 612 4615