[Gluster-devel] Gluster Coreutils

[Kaushal M]

Just a heads up on gogfapi. It is not complete as the directory
listing functions are yet to be implemented and it hasn't been tested
a lot.

The gogfapi package replicates golang's file API, which makes it very
easy to convert an existing go application to support gfapi.
Converting go-coreutils should be easy.

Also, the I'll not be maintaining the Gluster Forge repository, as the
forge is about to be closed. Use the github repository
http://github.com/kshlm/gogfapi instead.

~kaushal

On Mon, Jun 15, 2015 at 10:26 AM, Matthew McKeen <matthew at mmckeen.net> wrote:
> I agree, go would be perfect for these tools.
>
> Static compilation makes deployment trivial.
>
> +1
>
>
> On Sun, Jun 14, 2015, 9:50 PM Prashanth Pai <ppai at redhat.com> wrote:
>>
>> Personally, I'd use Go which is "performant" as you put it. You could
>> reuse(read fork) this project: https://github.com/aisola/go-coreutils
>> And also leverage Kaushal's go bindings
>> (https://forge.gluster.org/gogfapi#more) which itself can grow along with
>> glusterfs-coreutils project.
>>
>> Regards,
>>  -Prashanth Pai
>>
>> ----- chris holcombe <chris.holcombe at canonical.com> wrote:
>> > Having previously worked at Facebook myself I know that it's absolutely
>> > critical that these tools be as performant as possible. I understand the
>> > desire to program these in Python because it allows more people to
>> > participate but unfortunately in this case it's not possible.
>> >
>> > Craig - Let us know when you push your code.  I'll start lending a hand
>> > as soon as I can.
>> >
>> > On 06/14/2015 02:49 PM, Craig Cabrey wrote:
>> > > I've already started writing the utilities in C per my internship
>> > > project. I'll push these up when ready (most probably sometime this week) as
>> > > a POC.
>> > >
>> > > Maybe then we can look into implementing with Python?
>> > >
>> > > Craig
>> > >
>> > >> On Jun 14, 2015, at 2:47 PM, Joe Julian <joe at julianfamily.org> wrote:
>> > >>
>> > >> I was thinking the other way around. Write it in python then optimize
>> > >> if it's necessary.
>> > >>> On 06/14/2015 02:45 PM, chris holcombe wrote:
>> > >>> Maybe we could write these in C and setup python bindings for them.
>> > >>> Thoughts?  I'm down with writing them in C.  I could use more practice.
>> > >>>
>> > >>>> On 06/14/2015 02:36 PM, Joe Julian wrote:
>> > >>>> I would prefer python.
>> > >>>>
>> > >>>>> On 06/14/2015 11:18 AM, Niels de Vos wrote:
>> > >>>>>> On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat
>> > >>>>>> wrote:
>> > >>>>>> On 12 June 2015 at 23:59, chris holcombe
>> > >>>>>> <chris.holcombe at canonical.com>
>> > >>>>>> wrote:
>> > >>>>>>
>> > >>>>>>> Yeah I have this repo but it's basically empty:
>> > >>>>>>> https://github.com/cholcombe973/GlusterUtils
>> > >>>>>> AFAIK the plan is to collaborate through a git repo in
>> > >>>>>> github.com/gluster
>> > >>>>>> account. But anything that works should be good...
>> > >>>>>>
>> > >>>>>> And the choice of language seems to be python.
>> > >>>>> Depending on the target systems, Python may not be suitable. There
>> > >>>>> are
>> > >>>>> cloud deployments that do not have Python installed. I think that
>> > >>>>> even
>> > >>>>> includes the minimal cloud images Fedora and CentOS provide. IMHO
>> > >>>>> would
>> > >>>>> be nice to be able to support those systems too, without pulling
>> > >>>>> in too
>> > >>>>> many dependencies.
>> > >>>>>
>> > >>>>> But, I'll leave it up to the people writing the code ;-)
>> > >>>>>
>> > >>>>> Cheers,
>> > >>>>> Niels
>> > >>>>>
>> > >>>>>> Best Regards,
>> > >>>>>> Vishwanath
>> > >>>>>>
>> > >>>>>>>> On 06/12/2015 11:27 AM, Craig Cabrey wrote:
>> > >>>>>>>>
>> > >>>>>>>> Chris,
>> > >>>>>>>>
>> > >>>>>>>> That sounds good to me.
>> > >>>>>>>>
>> > >>>>>>>> I already have started on implementation, just to get familiar
>> > >>>>>>>> with the
>> > >>>>>>>> codebase and GFAPI.
>> > >>>>>>>>
>> > >>>>>>>> Is there a public repo that we can use for collaboration?
>> > >>>>>>>>
>> > >>>>>>>> Craig
>> > >>>>>>>>
>> > >>>>>>>>   On Jun 12, 2015, at 10:46 AM, chris holcombe <
>> > >>>>>>>>> chris.holcombe at canonical.com> wrote:
>> > >>>>>>>>>
>> > >>>>>>>>> Craig,
>> > >>>>>>>>>
>> > >>>>>>>>> I was actually planning on building the same tool set. I would
>> > >>>>>>>>> like to
>> > >>>>>>>>> work with you also on this if that's ok.
>> > >>>>>>>>>
>> > >>>>>>>>> -Chris
>> > >>>>>>>>>
>> > >>>>>>>>>> On 06/12/2015 10:43 AM, Jeff Darcy wrote:
>> > >>>>>>>>>>
>> > >>>>>>>>>> Hi everyone,
>> > >>>>>>>>>>> This summer I am an intern at Facebook working on the
>> > >>>>>>>>>>> Gluster team.
>> > >>>>>>>>>>> Part of
>> > >>>>>>>>>>> my project for the summer includes developing a set of
>> > >>>>>>>>>>> coreutils that
>> > >>>>>>>>>>> utilizes the Gluster C API natively.
>> > >>>>>>>>>>>
>> > >>>>>>>>>>> This project is similar in nature to the NFS coreutils that
>> > >>>>>>>>>>> some of
>> > >>>>>>>>>>> you may
>> > >>>>>>>>>>> have heard about from the other Facebook engineers at the
>> > >>>>>>>>>>> Gluster
>> > >>>>>>>>>>> summit
>> > >>>>>>>>>>> recently. I just wanted to reach out to the Gluster
>> > >>>>>>>>>>> community to gather
>> > >>>>>>>>>>> ideas, potential features, feedback, and direction.
>> > >>>>>>>>>>>
>> > >>>>>>>>>>> The initial set of utilities that I am developing includes
>> > >>>>>>>>>>> the
>> > >>>>>>>>>>> following:
>> > >>>>>>>>>>>
>> > >>>>>>>>>>> * cat
>> > >>>>>>>>>>> * mkdir
>> > >>>>>>>>>>> * put (read from stdin and write to a file)
>> > >>>>>>>>>>> * mv
>> > >>>>>>>>>>> * ls
>> > >>>>>>>>>>> * rm
>> > >>>>>>>>>>> * tail
>> > >>>>>>>>>>>
>> > >>>>>>>>>>> Again, any feedback will be welcome.
>> > >>>>>>>>>> Hi, Craig, and welcome to the project.  :)
>> > >>>>>>>>>>
>> > >>>>>>>>>> There seems to be some overlap with a proposal Ragahavendra
>> > >>>>>>>>>> Talur sent
>> > >>>>>>>>>> out
>> > >>>>>>>>>> a couple of days ago.
>> > >>>>>>>>>>
>> > >>>>>>>>>>
>> > >>>>>>>>>>
>> > >>>>>>>>>> https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharing&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0A&s=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162
>> > >>>>>>>>>>
>> > >>>>>>>>>> This seems like an excellent opportunity to collaborate.
>> > >>>>>>>>>> Ideally, I
>> > >>>>>>>>>> think
>> > >>>>>>>>>> it would be useful to have both an FTP-client-like "shell"
>> > >>>>>>>>>> and a set of
>> > >>>>>>>>>> standalone "one shot" commands, based on as much common code
>> > >>>>>>>>>> as
>> > >>>>>>>>>> possible.
>> > >>>>>>>>>>
>> > >>>>>>>>>> _______________________________________________
>> > >>>>>>>>>> Gluster-devel mailing list
>> > >>>>>>>>>> Gluster-devel at gluster.org
>> > >>>>>>>>>>
>> > >>>>>>>>>>
>> > >>>>>>>>>> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0A&s=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3
>> > >>>>>>> _______________________________________________
>> > >>>>>>> Gluster-devel mailing list
>> > >>>>>>> Gluster-devel at gluster.org
>> > >>>>>>>
>> > >>>>>>> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
>> > >>>>>> _______________________________________________
>> > >>>>>> Gluster-devel mailing list
>> > >>>>>> Gluster-devel at gluster.org
>> > >>>>>>
>> > >>>>>> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
>> > >>>>> _______________________________________________
>> > >>>>> Gluster-devel mailing list
>> > >>>>> Gluster-devel at gluster.org
>> > >>>>>
>> > >>>>> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
>> > >>>> _______________________________________________
>> > >>>> Gluster-devel mailing list
>> > >>>> Gluster-devel at gluster.org
>> > >>>>
>> > >>>> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
>> > >> _______________________________________________
>> > >> Gluster-devel mailing list
>> > >> Gluster-devel at gluster.org
>> > >>
>> > >> https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0A&s=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
>> >
>> > _______________________________________________
>> > Gluster-devel mailing list
>> > Gluster-devel at gluster.org
>> > http://www.gluster.org/mailman/listinfo/gluster-devel
>> _______________________________________________
>> Gluster-devel mailing list
>> Gluster-devel at gluster.org
>> http://www.gluster.org/mailman/listinfo/gluster-devel
>
>
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel
>