<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<br>
<pre class="moz-signature" cols="72">regards
Aravinda VK</pre>
<div class="moz-cite-prefix">On 06/27/2017 01:38 PM, Niels de Vos
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:20170627080846.GE5313@ndevos-x240.usersys.redhat.com">
<pre wrap="">On Tue, Jun 27, 2017 at 12:25:11PM +0530, Kotresh Hiremath Ravishankar wrote:
</pre>
<blockquote type="cite">
<pre wrap="">Hi,
We were looking for faster non-cryptographic hash to be used for the
gfid2path infra [1]
The initial testing was done with md5 128bit checksum which was a slow,
cryptographic hash
and using it makes software not complaint to FIPS [2]
On searching online a bit we found out xxhash [3] seems to be faster from
the results of
benchmark tests shared and lot of projects use it. So we have decided to us
xxHash
and added following files to gluster code base with the patch [4]
BSD 2-Clause License:
contrib/xxhash/xxhash.c
contrib/xxhash/xxhash.h
GPL v2 License:
tests/utils/xxhsum.c
NOTE: We have ignored the code guideline check for these files as
maintaining it
further becomes difficult.
Please comment on the same if there are any issues around it.
</pre>
</blockquote>
<pre wrap="">
How performance critical is the hashing for gfid2path? </pre>
</blockquote>
For this we need non-crypto hashing. This hash calculation will be
in the I/O path(Affected FOPs are create, mknod, link, symlink,
rename, unlink)
<blockquote type="cite"
cite="mid:20170627080846.GE5313@ndevos-x240.usersys.redhat.com">
<pre wrap="">
What is the plan to keep these files maintained? At minimal we need to
add these files to MAINTAINERS and the maintainers need to cherry-pick
updates and bugfixes from the original project. The few patches a year
makes this a recurring task that should not be forgoten. It would be
much better to use this as an external library that is provided by the
distributions. We already rely on OpenSSL, does this library not provide
an alternative 'FIPS approved' hashing that performs reasonably well?</pre>
</blockquote>
I think, this library is not available in distribution packaging
yet. Please suggest if you know any non-crypto hashing lib which is
already available in distros.<br>
<blockquote type="cite"
cite="mid:20170627080846.GE5313@ndevos-x240.usersys.redhat.com">
<pre wrap="">
Some distributions are very strict on bundling external projects, and we
need to inform the packagers about the additions so that they can handle
it correctly. Adding an external project to contrib/ should be mentioned
in the release notes at the very least.
Note that none of the symbols of any public functions in Gluster may
collide with functions in standard distribution libraries. This causes
for regular problems with gfapi applications. All exposed symbols that
get imported in contrib/ should have a gf_ prefix.
Thanks,
Niels
</pre>
<blockquote type="cite">
<pre wrap="">
[1] Issue: <a class="moz-txt-link-freetext" href="https://github.com/gluster/glusterfs/issues/139">https://github.com/gluster/glusterfs/issues/139</a>
[2] <a class="moz-txt-link-freetext" href="https://en.wikipedia.org/wiki/Federal_Information_Processing_Standards">https://en.wikipedia.org/wiki/Federal_Information_Processing_Standards</a>
[3] <a class="moz-txt-link-freetext" href="http://cyan4973.github.io/xxHash/">http://cyan4973.github.io/xxHash/</a>
[4] <a class="moz-txt-link-freetext" href="https://review.gluster.org/#/c/17488/10">https://review.gluster.org/#/c/17488/10</a>
--
Thanks and Regards,
Kotresh H R and Aravinda VK
</pre>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Gluster-devel mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-devel@gluster.org">Gluster-devel@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://lists.gluster.org/mailman/listinfo/gluster-devel">http://lists.gluster.org/mailman/listinfo/gluster-devel</a></pre>
</blockquote>
</blockquote>
<br>
</body>
</html>