[Gluster-users] local caching of file across global cluster

Jay Vyas jayunit100 at gmail.com
Fri May 31 15:05:21 UTC 2013


Is there any value / way to tell all the gluster nodes to make a file
highly available, potentially at the cost of consistency (i.e. forget about
locks for all files named XXXX and cache them in local disk)?

Scenario: Imagine I have a workflow of processing 1 million files, and I
want to compare all 1 billion files to all the words in , say, a set of ten
files, each of which are 10MB.

It would be easy to cache the ten files (100MB of data) on every local
gluster node.   Or even in memory for that matter.

Admittedly...Im not an expert on disk caching so, maybe, this is already
done using heuristics for us... and its just a matter of time for
FUSE/Underlying filesystem/Gluster mount to figure out that a file is
important before it starts caching it in some magical sort of way.

-- 
Jay Vyas
http://jayunit100.blogspot.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20130531/0741388a/attachment.html>


More information about the Gluster-users mailing list