[Gluster-devel] Gluster Coreutils

Mon Jun 15 04:49:54 UTC 2015

Personally, I'd use Go which is "performant" as you put it. You could reuse(read fork) this project: https://github.com/aisola/go-coreutils
And also leverage Kaushal's go bindings (https://forge.gluster.org/gogfapi#more) which itself can grow along with glusterfs-coreutils project.

Regards,
 -Prashanth Pai

----- chris holcombe <chris.holcombe at canonical.com> wrote:
> Having previously worked at Facebook myself I know that it's absolutely 
> critical that these tools be as performant as possible. I understand the 
> desire to program these in Python because it allows more people to 
> participate but unfortunately in this case it's not possible.
> 
> Craig - Let us know when you push your code.  I'll start lending a hand 
> as soon as I can.
> 
> On 06/14/2015 02:49 PM, Craig Cabrey wrote:
> > I've already started writing the utilities in C per my internship project. I'll push these up when ready (most probably sometime this week) as a POC.
> >
> > Maybe then we can look into implementing with Python?
> >
> > Craig
> >
> >> On Jun 14, 2015, at 2:47 PM, Joe Julian <joe at julianfamily.org> wrote:
> >>
> >> I was thinking the other way around. Write it in python then optimize if it's necessary.
> >>> On 06/14/2015 02:45 PM, chris holcombe wrote:
> >>> Maybe we could write these in C and setup python bindings for them. Thoughts?  I'm down with writing them in C.  I could use more practice.
> >>>
> >>>> On 06/14/2015 02:36 PM, Joe Julian wrote:
> >>>> I would prefer python.
> >>>>
> >>>>> On 06/14/2015 11:18 AM, Niels de Vos wrote:
> >>>>>> On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote:
> >>>>>> On 12 June 2015 at 23:59, chris holcombe <chris.holcombe at canonical.com>
> >>>>>> wrote:
> >>>>>>
> >>>>>>> Yeah I have this repo but it's basically empty:
> >>>>>>> https://github.com/cholcombe973/GlusterUtils
> >>>>>> AFAIK the plan is to collaborate through a git repo in github.com/gluster
> >>>>>> account. But anything that works should be good...
> >>>>>>
> >>>>>> And the choice of language seems to be python.
> >>>>> Depending on the target systems, Python may not be suitable. There are
> >>>>> cloud deployments that do not have Python installed. I think that even
> >>>>> includes the minimal cloud images Fedora and CentOS provide. IMHO would
> >>>>> be nice to be able to support those systems too, without pulling in too
> >>>>> many dependencies.
> >>>>>
> >>>>> But, I'll leave it up to the people writing the code ;-)
> >>>>>
> >>>>> Cheers,
> >>>>> Niels
> >>>>>
> >>>>>> Best Regards,
> >>>>>> Vishwanath
> >>>>>>
> >>>>>>>> On 06/12/2015 11:27 AM, Craig Cabrey wrote:
> >>>>>>>>
> >>>>>>>> Chris,
> >>>>>>>>
> >>>>>>>> That sounds good to me.
> >>>>>>>>
> >>>>>>>> I already have started on implementation, just to get familiar with the
> >>>>>>>> codebase and GFAPI.
> >>>>>>>>
> >>>>>>>> Is there a public repo that we can use for collaboration?
> >>>>>>>>
> >>>>>>>> Craig
> >>>>>>>>
> >>>>>>>>   On Jun 12, 2015, at 10:46 AM, chris holcombe <
> >>>>>>>>> chris.holcombe at canonical.com> wrote:
> >>>>>>>>>
> >>>>>>>>> Craig,
> >>>>>>>>>
> >>>>>>>>> I was actually planning on building the same tool set. I would like to
> >>>>>>>>> work with you also on this if that's ok.
> >>>>>>>>>
> >>>>>>>>> -Chris
> >>>>>>>>>
> >>>>>>>>>> On 06/12/2015 10:43 AM, Jeff Darcy wrote:
> >>>>>>>>>>
> >>>>>>>>>> Hi everyone,
> >>>>>>>>>>> This summer I am an intern at Facebook working on the Gluster team.
> >>>>>>>>>>> Part of
> >>>>>>>>>>> my project for the summer includes developing a set of coreutils that
> >>>>>>>>>>> utilizes the Gluster C API natively.
> >>>>>>>>>>>
> >>>>>>>>>>> This project is similar in nature to the NFS coreutils that some of
> >>>>>>>>>>> you may
> >>>>>>>>>>> have heard about from the other Facebook engineers at the Gluster
> >>>>>>>>>>> summit
> >>>>>>>>>>> recently. I just wanted to reach out to the Gluster community to gather
> >>>>>>>>>>> ideas, potential features, feedback, and direction.
> >>>>>>>>>>>
> >>>>>>>>>>> The initial set of utilities that I am developing includes the
> >>>>>>>>>>> following:
> >>>>>>>>>>>
> >>>>>>>>>>> * cat
> >>>>>>>>>>> * mkdir
> >>>>>>>>>>> * put (read from stdin and write to a file)
> >>>>>>>>>>> * mv
> >>>>>>>>>>> * ls
> >>>>>>>>>>> * rm
> >>>>>>>>>>> * tail
> >>>>>>>>>>>
> >>>>>>>>>>> Again, any feedback will be welcome.
> >>>>>>>>>> Hi, Craig, and welcome to the project.  :)
> >>>>>>>>>>
> >>>>>>>>>> There seems to be some overlap with a proposal Ragahavendra Talur sent
> >>>>>>>>>> out
> >>>>>>>>>> a couple of days ago.
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharing&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0A&s=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162
> >>>>>>>>>>
> >>>>>>>>>> This seems like an excellent opportunity to collaborate.  Ideally, I
> >>>>>>>>>> think
> >>>>>>>>>> it would be useful to have both an FTP-client-like "shell" and a set of
> >>>>>>>>>> standalone "one shot" commands, based on as much common code as
> >>>>>>>>>> possible.
> >>>>>>>>>>
> >>>>>>>>>> _______________________________________________
> >>>>>>>>>> Gluster-devel mailing list
> >>>>>>>>>> Gluster-devel at gluster.org
> >>>>>>>>>>
> >>>>>>>>>> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0A&s=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3
> >>>>>>> _______________________________________________
> >>>>>>> Gluster-devel mailing list
> >>>>>>> Gluster-devel at gluster.org
> >>>>>>> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
> >>>>>> _______________________________________________
> >>>>>> Gluster-devel mailing list
> >>>>>> Gluster-devel at gluster.org
> >>>>>> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
> >>>>> _______________________________________________
> >>>>> Gluster-devel mailing list
> >>>>> Gluster-devel at gluster.org
> >>>>> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
> >>>> _______________________________________________
> >>>> Gluster-devel mailing list
> >>>> Gluster-devel at gluster.org
> >>>> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
> >> _______________________________________________
> >> Gluster-devel mailing list
> >> Gluster-devel at gluster.org
> >> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
> 
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel