<div dir="auto">Hi Nithya,<div dir="auto"><br></div><div dir="auto">We are having the setup where copying the file to and deleting it from gluster mount point to update the latest file. We noticed due to this having some memory increase in glusterfsd process. </div><div dir="auto"><br></div><div dir="auto">To find the memory leak we are using valgrind but didn't get any help.</div><div dir="auto"><br></div><div dir="auto">That's why contacted to glusterfs community.</div><div dir="auto"><br></div><div dir="auto">Regards,</div><div dir="auto">Abhishek</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jun 6, 2019, 16:08 Nithya Balachandran <<a href="mailto:nbalacha@redhat.com">nbalacha@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Abhishek,<div><br></div><div>I am still not clear as to the purpose of the tests. Can you clarify why you are using valgrind and why you think there is a memory leak?</div><div><br></div><div>Regards,</div><div>Nithya</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, 6 Jun 2019 at 12:09, ABHISHEK PALIWAL <<a href="mailto:abhishpaliwal@gmail.com" target="_blank" rel="noreferrer">abhishpaliwal@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hi Nithya,</div><div><br></div><div>Here is the Setup details and test which we are doing as below:<br><br><br>One client, two gluster Server. <br>The client is writing and deleting one file each 15 minutes by script <a href="http://test_v4.15.sh" target="_blank" rel="noreferrer">test_v4.15.sh</a>.<br><br>IP <br>Server side:<br>128.224.98.157 /gluster/gv0/<br>128.224.98.159 /gluster/gv0/<br><br>Client side:<br>128.224.98.160 /gluster_mount/<br><br>Server side:<br>gluster volume create gv0 replica 2 128.224.98.157:/gluster/gv0/ 128.224.98.159:/gluster/gv0/ force<br>gluster volume start gv0<br><br>root@128:/tmp/brick/gv0# gluster volume info <br><br>Volume Name: gv0<br>Type: Replicate<br>Volume ID: 7105a475-5929-4d60-ba23-be57445d97b5<br>Status: Started<br>Snapshot Count: 0<br>Number of Bricks: 1 x 2 = 2<br>Transport-type: tcp<br>Bricks:<br>Brick1: 128.224.98.157:/gluster/gv0<br>Brick2: 128.224.98.159:/gluster/gv0<br>Options Reconfigured:<br>transport.address-family: inet<br>nfs.disable: on<br>performance.client-io-threads: off<br><br>exec script: ./ps_mem.py -p 605 -w 61 > log<br>root@128:/# ./ps_mem.py -p 605<br>Private + Shared = RAM used Program<br>23668.0 KiB + 1188.0 KiB = 24856.0 KiB glusterfsd<br>---------------------------------<br>24856.0 KiB<br>=================================<br><br><br>Client side:<br>mount -t glusterfs -o acl -o resolve-gids 128.224.98.157:gv0 /gluster_mount<br><br><br>We are using the below script write and delete the file.<br><br><b><a href="http://test_v4.15.sh" target="_blank" rel="noreferrer">test_v4.15.sh</a></b><br><br>Also the below script to see the memory increase whihle the script is above script is running in background.<br><br><b>ps_mem.py</b></div><div><b><br></b></div><div>I am attaching the script files as well as the result got after testing the scenario.<br></div><div><b></b></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jun 5, 2019 at 7:23 PM Nithya Balachandran <<a href="mailto:nbalacha@redhat.com" target="_blank" rel="noreferrer">nbalacha@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi,<div><br></div><div>Writing to a volume should not affect glusterd. The stack you have shown in the valgrind looks like the memory used to initialise the structures glusterd uses and will free only when it is stopped.</div><div><br></div><div>Can you provide more details to what it is you are trying to test?</div><div><br></div><div>Regards,</div><div>Nithya</div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, 4 Jun 2019 at 15:41, ABHISHEK PALIWAL <<a href="mailto:abhishpaliwal@gmail.com" target="_blank" rel="noreferrer">abhishpaliwal@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hi Team,</div><div><br></div><div>Please respond on the issue which I raised.</div><div><br></div><div>Regards,</div><div>Abhishek<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, May 17, 2019 at 2:46 PM ABHISHEK PALIWAL <<a href="mailto:abhishpaliwal@gmail.com" target="_blank" rel="noreferrer">abhishpaliwal@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto"><div>Anyone please reply....<br><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, May 16, 2019, 10:49 ABHISHEK PALIWAL <<a href="mailto:abhishpaliwal@gmail.com" target="_blank" rel="noreferrer">abhishpaliwal@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi Team,<div><br></div><div><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">I upload some valgrind logs from my gluster 5.4 setup. This is writing to the volume every 15 minutes. I stopped glusterd and then copy away the logs. The test was running for some simulated days. They are zipped in valgrind-54.zip.</span><br clear="all"><div><br></div><div><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">Lots of info in valgrind-2730.log. Lots of possibly lost bytes in glusterfs and even some definitely lost bytes.</span><br></div><div><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><br></span></div><div><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== 1,572,880 bytes in 1 blocks are possibly lost in loss record 391 of 391</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== at 0x4C29C25: calloc (in /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so)</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== by 0xA22485E: ??? (in /usr/lib64/glusterfs/5.4/xlator/mgmt/glusterd.so)</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== by 0xA217C94: ??? (in /usr/lib64/glusterfs/5.4/xlator/mgmt/glusterd.so)</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== by 0xA21D9F8: ??? (in /usr/lib64/glusterfs/5.4/xlator/mgmt/glusterd.so)</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== by 0xA21DED9: ??? (in /usr/lib64/glusterfs/5.4/xlator/mgmt/glusterd.so)</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== by 0xA21E685: ??? (in /usr/lib64/glusterfs/5.4/xlator/mgmt/glusterd.so)</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== by 0xA1B9D8C: init (in /usr/lib64/glusterfs/5.4/xlator/mgmt/glusterd.so)</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== by 0x4E511CE: xlator_init (in /usr/lib64/libglusterfs.so.0.0.1)</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== by 0x4E8A2B8: ??? (in /usr/lib64/libglusterfs.so.0.0.1)</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== by 0x4E8AAB3: glusterfs_graph_activate (in /usr/lib64/libglusterfs.so.0.0.1)</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== by 0x409C35: glusterfs_process_volfp (in /usr/sbin/glusterfsd)</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== by 0x409D99: glusterfs_volumes_init (in /usr/sbin/glusterfsd)</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737==</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== LEAK SUMMARY:</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== definitely lost: 1,053 bytes in 10 blocks</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== indirectly lost: 317 bytes in 3 blocks</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== possibly lost: 2,374,971 bytes in 524 blocks</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== still reachable: 53,277 bytes in 201 blocks</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">==2737== suppressed: 0 bytes in 0 blocks</span></div></div><div><br></div>-- <br><div dir="ltr" class="m_-4966288562388219657gmail-m_-1803716590219513870gmail-m_4810025679290933340gmail-m_-4112943464701382707gmail-m_-986370699878857446m_-6023903392365563892gmail_signature"><div dir="ltr"><br><br><br><br>Regards<br>
Abhishek Paliwal<br>
</div></div></div>
</blockquote></div></div></div>
</blockquote></div><br clear="all"><br>-- <br><div dir="ltr" class="m_-4966288562388219657gmail-m_-1803716590219513870gmail-m_4810025679290933340gmail-m_-4112943464701382707gmail_signature"><div dir="ltr"><br><br><br><br>Regards<br>
Abhishek Paliwal<br>
</div></div>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank" rel="noreferrer">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a></blockquote></div>
</blockquote></div><br clear="all"><br>-- <br><div dir="ltr" class="m_-4966288562388219657gmail-m_-1803716590219513870gmail_signature"><div dir="ltr"><br><br><br><br>Regards<br>
Abhishek Paliwal<br>
</div></div>
</blockquote></div>
</blockquote></div>