[Gluster-devel] Gluster Coreutils

Mon Jun 15 04:56:31 UTC 2015

I agree, go would be perfect for these tools.

Static compilation makes deployment trivial.

+1

On Sun, Jun 14, 2015, 9:50 PM Prashanth Pai <ppai at redhat.com> wrote:

> Personally, I'd use Go which is "performant" as you put it. You could
> reuse(read fork) this project: https://github.com/aisola/go-coreutils
> And also leverage Kaushal's go bindings (
> https://forge.gluster.org/gogfapi#more) which itself can grow along with
> glusterfs-coreutils project.
>
> Regards,
>  -Prashanth Pai
>
> ----- chris holcombe <chris.holcombe at canonical.com> wrote:
> > Having previously worked at Facebook myself I know that it's absolutely
> > critical that these tools be as performant as possible. I understand the
> > desire to program these in Python because it allows more people to
> > participate but unfortunately in this case it's not possible.
> >
> > Craig - Let us know when you push your code.  I'll start lending a hand
> > as soon as I can.
> >
> > On 06/14/2015 02:49 PM, Craig Cabrey wrote:
> > > I've already started writing the utilities in C per my internship
> project. I'll push these up when ready (most probably sometime this week)
> as a POC.
> > >
> > > Maybe then we can look into implementing with Python?
> > >
> > > Craig
> > >
> > >> On Jun 14, 2015, at 2:47 PM, Joe Julian <joe at julianfamily.org> wrote:
> > >>
> > >> I was thinking the other way around. Write it in python then optimize
> if it's necessary.
> > >>> On 06/14/2015 02:45 PM, chris holcombe wrote:
> > >>> Maybe we could write these in C and setup python bindings for them.
> Thoughts?  I'm down with writing them in C.  I could use more practice.
> > >>>
> > >>>> On 06/14/2015 02:36 PM, Joe Julian wrote:
> > >>>> I would prefer python.
> > >>>>
> > >>>>> On 06/14/2015 11:18 AM, Niels de Vos wrote:
> > >>>>>> On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat
> wrote:
> > >>>>>> On 12 June 2015 at 23:59, chris holcombe <
> chris.holcombe at canonical.com>
> > >>>>>> wrote:
> > >>>>>>
> > >>>>>>> Yeah I have this repo but it's basically empty:
> > >>>>>>> https://github.com/cholcombe973/GlusterUtils
> > >>>>>> AFAIK the plan is to collaborate through a git repo in
> github.com/gluster
> > >>>>>> account. But anything that works should be good...
> > >>>>>>
> > >>>>>> And the choice of language seems to be python.
> > >>>>> Depending on the target systems, Python may not be suitable. There
> are
> > >>>>> cloud deployments that do not have Python installed. I think that
> even
> > >>>>> includes the minimal cloud images Fedora and CentOS provide. IMHO
> would
> > >>>>> be nice to be able to support those systems too, without pulling
> in too
> > >>>>> many dependencies.
> > >>>>>
> > >>>>> But, I'll leave it up to the people writing the code ;-)
> > >>>>>
> > >>>>> Cheers,
> > >>>>> Niels
> > >>>>>
> > >>>>>> Best Regards,
> > >>>>>> Vishwanath
> > >>>>>>
> > >>>>>>>> On 06/12/2015 11:27 AM, Craig Cabrey wrote:
> > >>>>>>>>
> > >>>>>>>> Chris,
> > >>>>>>>>
> > >>>>>>>> That sounds good to me.
> > >>>>>>>>
> > >>>>>>>> I already have started on implementation, just to get familiar
> with the
> > >>>>>>>> codebase and GFAPI.
> > >>>>>>>>
> > >>>>>>>> Is there a public repo that we can use for collaboration?
> > >>>>>>>>
> > >>>>>>>> Craig
> > >>>>>>>>
> > >>>>>>>>   On Jun 12, 2015, at 10:46 AM, chris holcombe <
> > >>>>>>>>> chris.holcombe at canonical.com> wrote:
> > >>>>>>>>>
> > >>>>>>>>> Craig,
> > >>>>>>>>>
> > >>>>>>>>> I was actually planning on building the same tool set. I would
> like to
> > >>>>>>>>> work with you also on this if that's ok.
> > >>>>>>>>>
> > >>>>>>>>> -Chris
> > >>>>>>>>>
> > >>>>>>>>>> On 06/12/2015 10:43 AM, Jeff Darcy wrote:
> > >>>>>>>>>>
> > >>>>>>>>>> Hi everyone,
> > >>>>>>>>>>> This summer I am an intern at Facebook working on the
> Gluster team.
> > >>>>>>>>>>> Part of
> > >>>>>>>>>>> my project for the summer includes developing a set of
> coreutils that
> > >>>>>>>>>>> utilizes the Gluster C API natively.
> > >>>>>>>>>>>
> > >>>>>>>>>>> This project is similar in nature to the NFS coreutils that
> some of
> > >>>>>>>>>>> you may
> > >>>>>>>>>>> have heard about from the other Facebook engineers at the
> Gluster
> > >>>>>>>>>>> summit
> > >>>>>>>>>>> recently. I just wanted to reach out to the Gluster
> community to gather
> > >>>>>>>>>>> ideas, potential features, feedback, and direction.
> > >>>>>>>>>>>
> > >>>>>>>>>>> The initial set of utilities that I am developing includes
> the
> > >>>>>>>>>>> following:
> > >>>>>>>>>>>
> > >>>>>>>>>>> * cat
> > >>>>>>>>>>> * mkdir
> > >>>>>>>>>>> * put (read from stdin and write to a file)
> > >>>>>>>>>>> * mv
> > >>>>>>>>>>> * ls
> > >>>>>>>>>>> * rm
> > >>>>>>>>>>> * tail
> > >>>>>>>>>>>
> > >>>>>>>>>>> Again, any feedback will be welcome.
> > >>>>>>>>>> Hi, Craig, and welcome to the project.  :)
> > >>>>>>>>>>
> > >>>>>>>>>> There seems to be some overlap with a proposal Ragahavendra
> Talur sent
> > >>>>>>>>>> out
> > >>>>>>>>>> a couple of days ago.
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharing&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0A&s=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162
> > >>>>>>>>>>
> > >>>>>>>>>> This seems like an excellent opportunity to collaborate.
> Ideally, I
> > >>>>>>>>>> think
> > >>>>>>>>>> it would be useful to have both an FTP-client-like "shell"
> and a set of
> > >>>>>>>>>> standalone "one shot" commands, based on as much common code
> as
> > >>>>>>>>>> possible.
> > >>>>>>>>>>
> > >>>>>>>>>> _______________________________________________
> > >>>>>>>>>> Gluster-devel mailing list
> > >>>>>>>>>> Gluster-devel at gluster.org
> > >>>>>>>>>>
> > >>>>>>>>>>
> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0A&s=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3
> > >>>>>>> _______________________________________________
> > >>>>>>> Gluster-devel mailing list
> > >>>>>>> Gluster-devel at gluster.org
> > >>>>>>>
> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
> > >>>>>> _______________________________________________
> > >>>>>> Gluster-devel mailing list
> > >>>>>> Gluster-devel at gluster.org
> > >>>>>>
> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
> > >>>>> _______________________________________________
> > >>>>> Gluster-devel mailing list
> > >>>>> Gluster-devel at gluster.org
> > >>>>>
> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
> > >>>> _______________________________________________
> > >>>> Gluster-devel mailing list
> > >>>> Gluster-devel at gluster.org
> > >>>>
> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
> > >> _______________________________________________
> > >> Gluster-devel mailing list
> > >> Gluster-devel at gluster.org
> > >>
> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
> >
> > _______________________________________________
> > Gluster-devel mailing list
> > Gluster-devel at gluster.org
> > http://www.gluster.org/mailman/listinfo/gluster-devel
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-devel/attachments/20150615/c969ffad/attachment-0001.html>