[Gluster-devel] Language Bindings and Data Serialization in Gluster

[Jay Vyas]

+1 for a gluster/Thrift service that serves up metadata and or files.  not
sure how it would be distributed though.  but i would love that :)




On Fri, Feb 15, 2013 at 12:46 AM, Brad Childs <bdc at redhat.com> wrote:

> I'm working on a hadoop/gluster integration.  First, whoever wrote the
> initial map/reduce gluster DFS layer did a great job.  Same with the FUSE
> layer--  FUSE alone solves a lot of problems.
>
> However, some of the hadoop architectures require cross language (java)
> bindings with gluster (c). Other's I've talked to about cross language
> bindings have shown interest in gluster--> python and ruby bindings.  From
> the research I've done, most of a common language interface is simple and
> the only tricky part is data serialization.
>
> I'm not an expert in data serialization across programming languages so
> it's been a lot of research.  There's a few new and old solutions to the
> problem but I think the older non IDL solutions are obvious and not really
> that interesting (RPC, ASN.1, raw JNI or other language specific native
> access).
>
> Moving up to IDL abstractions, there's Thrift, Protobuf and SWIG.  SWIG is
> really good for simple multi-language bindings but requires manual data
> serialization.
>
> From my research the common solutions for multi-language serialization
> today is either protobuf or thrift.   Thrift is a facebook originated
> solution (now under apache) and protobuf is google's open solution.
>
> I'm leaning towards thrift since it's apache.  A few of the hadoop
> architectures already support thrift so that would simplify things.  What's
> your opinion?  Is anyone familiar with, or already solved I/O serialization
> across programming languages in gluster? I'd love some feedback and
> discussion.
>
> Links:
> SWIG: http://www.swig.org/
> Protobuf: http://code.google.com/p/protobuf/
> Serialization Discussion:
> http://stackoverflow.com/questions/4633611/what-are-the-key-differences-between-apache-thrift-google-protocol-buffers-mes
> Previous Gluster Interface Pitch:
> https://fedoraproject.org/wiki/Summer_coding_ideas_for_2012#Implement_a_binding_translator_for_GlusterFS
>
> Humor: http://www.quickmeme.com/meme/3t05wa/
>
>
> Thanks!
> bradley childs
>
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at nongnu.org
> https://lists.nongnu.org/mailman/listinfo/gluster-devel
>



-- 
Jay Vyas
http://jayunit100.blogspot.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-devel/attachments/20130215/a1adc052/attachment-0001.html>