landman at scalableinformatics.com
Tue Feb 14 12:47:30 UTC 2012
On 02/06/2012 01:41 PM, Andrew Holway wrote:
> Can anyone tell me about their experiences with 1PB and larger gluster
> installations. We are thinking of doing 1PB with 10x 100PB storage
> servers and would appreciate some reassurance :). We plan to scale
> to....above and beyond....
We've got a bit of experience in scaling to (many large) bricks for
gluster. The big issues are reliable/working network connections,
RAIDs, etc. Currently you should look carefully at some sort of
replication mechanism (if you are storing 1PB of data, recovery time is
100TB bricks aren't a problem (as long as they are built sanely),
though I'd probably suggest subdividing smaller so you can take better
advantage of finer grain parallelism. The issue on design of the bricks
goes to the bandwidth and the height of the storage bandwidth wall (time
required to read/write the entire 100TB). For most designs we see
(cascading arrays with SAS/FC), this is going to be problematic at best.
But thats another story (and we are biased because of what we do).
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics Inc.
email: landman at scalableinformatics.com
web : http://scalableinformatics.com
phone: +1 734 786 8423 x121
fax : +1 866 888 3112
cell : +1 734 612 4615
More information about the Gluster-users