<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.E-MailFormatvorlage18
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.E-MailFormatvorlage19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
p.msipfooterdc12b1d1, li.msipfooterdc12b1d1, div.msipfooterdc12b1d1
{mso-style-name:msipfooterdc12b1d1;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="DE-AT" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">Hi Robert,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span lang="EN-US">We had a similar issue and it turned out that heketi stores and counts free/used space in its topology separately to underlying LVM.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">This means it can run out of sync.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">I found this article which is a nice walkthrough how to sync them again:
</span><a href="https://www.ibm.com/support/knowledgecenter/en/SSBS6K_3.1.0/troubleshoot/heketi_disk.html"><span lang="EN-US">https://www.ibm.com/support/knowledgecenter/en/SSBS6K_3.1.0/troubleshoot/heketi_disk.html</span></a><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal" style="text-autospace:none"><span style="color:black;mso-fareast-language:DE-AT">Mit freundlichen Grüßen / Best regards<o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="color:black;mso-fareast-language:DE-AT"><o:p> </o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="color:black;mso-fareast-language:DE-AT">i.A. Dipl.-Ing.(FH) Johannes Grumböck<o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-US" style="color:black;mso-fareast-language:DE-AT">Infrastructure Architect, Computing & Platform Services<o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-US" style="color:black;mso-fareast-language:DE-AT">Infrastructure & Common Platforms<o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-US" style="color:black;mso-fareast-language:DE-AT"><o:p> </o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="color:gray;mso-fareast-language:DE-AT">Telefon +43 (0)662 4670-6323<o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="color:gray;mso-fareast-language:DE-AT">Telefax +43 (0)662 4670-16323<o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><u><span style="color:blue;mso-fareast-language:DE-AT">johannes.grumboeck@porscheinformatik.at<o:p></o:p></span></u></p>
<p class="MsoNormal" style="text-autospace:none"><u><span style="font-size:10.0pt;color:blue;mso-fareast-language:DE-AT"><o:p><span style="text-decoration:none"> </span></o:p></span></u></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;color:gray;mso-fareast-language:DE-AT">Porsche Informatik Gesellschaft m.b.H. | A – 5020 Salzburg | Louise-Piëch-Straße 9<o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;color:gray;mso-fareast-language:DE-AT">Sitz: Salzburg | FN 72830 d / Landesgericht Salzburg | DVR 88439 | UID ATU 36773309<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:gray;mso-fareast-language:DE-AT"><a href="http://www.porscheinformatik.at/"><span style="color:blue">http://www.porscheinformatik.at/</span></a></span><span style="font-size:10.0pt;mso-fareast-language:DE-AT"><o:p></o:p></span></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="mso-fareast-language:DE-AT"><o:p> </o:p></span></p>
<p class="msipfooterdc12b1d1" align="center" style="margin:0cm;margin-bottom:.0001pt;text-align:center">
<span style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#001753">Internal</span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="DE" style="mso-fareast-language:DE-AT">Von:</span></b><span lang="DE" style="mso-fareast-language:DE-AT"> heketi-devel-bounces@gluster.org <heketi-devel-bounces@gluster.org>
<b>Im Auftrag von </b>Polasek, Robert<br>
<b>Gesendet:</b> Donnerstag, 25. Oktober 2018 22:30<br>
<b>An:</b> heketi-devel@gluster.org<br>
<b>Betreff:</b> [EXT] [heketi-devel] volume provisioning fails with "No space"<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span lang="EN-CA">Hi everybody,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">I am testing heketi autoprovisioning of gluster volumes and I am hitting a problem where heketi reports "No space" in the log, even there should be a space.
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">Would somebody be able to point me what I need to look into or where my problem is? Here are the details of my problem:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">I am using a curl to simulate my failing request from kubernetes. As a side note, our kubernetes is old, 1.4 and therefore I cannot
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">robert@workstation:~/src/ifds/helm/tapremium$ curl -v -X POST -H "Authorization: bearer ****" -H "Content-Type: application/json" POST
<a href="http://localhost:8080/volumes">http://localhost:8080/volumes</a> <a href="mailto:-d@/tmp/volume.json">
-d@/tmp/volume.json</a><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">=================================================================================================================<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">This is a content of /tmp/volume.json file<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">{<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> "size": 10,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> "name": "",<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> "durability": {<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> "type": "replicate",<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> "replicate": {<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> "replica": 3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> },<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> "disperse": {}<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> },<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> "gid": 2000,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> "snapshot": {<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> "enable": false,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> "factor": 0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> }<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">}<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">This is my topology<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">=================================================================================================================<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">Cluster Id: 7396c8b03593f9bfa1288cdebd9412ac<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Volumes:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Name: vol_4708719dddaacda301e3b71763cb73fa<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Size: 10<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Id: 4708719dddaacda301e3b71763cb73fa<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Cluster Id: 7396c8b03593f9bfa1288cdebd9412ac<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Mount: 192.168.48.9:vol_4708719dddaacda301e3b71763cb73fa<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Mount Options: backup-volfile-servers=<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Durability Type: none<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Snapshot: Disabled<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Bricks:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Id: 99b33f7f23347c1691e4a93c7220af04<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Path: /var/lib/heketi/mounts/vg_05df77bacca68b941f8d3d20d64a1aa2/brick_99b33f7f23347c1691e4a93c7220af04/brick<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Size (GiB): 5<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Node: 31e1ac3014029ff48398a989c10952b6<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Device: 05df77bacca68b941f8d3d20d64a1aa2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Id: acebc8961ffb304fa2b97c201c7af8da<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Path: /var/lib/heketi/mounts/vg_05df77bacca68b941f8d3d20d64a1aa2/brick_acebc8961ffb304fa2b97c201c7af8da/brick<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Size (GiB): 5<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Node: 31e1ac3014029ff48398a989c10952b6<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Device: 05df77bacca68b941f8d3d20d64a1aa2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Nodes:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Node Id: 31e1ac3014029ff48398a989c10952b6<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> State: online<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Cluster Id: 7396c8b03593f9bfa1288cdebd9412ac<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Zone: 1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Management Hostname: 192.168.48.9<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Storage Hostname: 192.168.48.9<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Devices:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Id:05df77bacca68b941f8d3d20d64a1aa2 Name:/dev/gluster_vg/heketi_volumeState:online Size (GiB):99 Used (GiB):10 Free (GiB):89
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Bricks:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Id:99b33f7f23347c1691e4a93c7220af04 Size (GiB):5 Path: /var/lib/heketi/mounts/vg_05df77bacca68b941f8d3d20d64a1aa2/brick_99b33f7f23347c1691e4a93c7220af04/brick<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Id:acebc8961ffb304fa2b97c201c7af8da Size (GiB):5 Path: /var/lib/heketi/mounts/vg_05df77bacca68b941f8d3d20d64a1aa2/brick_acebc8961ffb304fa2b97c201c7af8da/brick<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Id:6c0325d31e1b84a4f3aa088ba352e2ec Name:/dev/gluster_vg/heketi_volume2State:online Size (GiB):24 Used (GiB):0 Free (GiB):24
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Bricks:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Id:bac78b5e4d558d387218d12fdfb7bfa0 Name:/dev/gluster_vg/heketi_volume1State:online Size (GiB):24 Used (GiB):0 Free (GiB):24
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"> Bricks:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">=================================================================================================================<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">and this is the log output<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[negroni] Started POST /volumes<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry.go:101: [e8cb84a8b977a00d77e137a05a5b2530] Replica 3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry.go:580: Using the following clusters: [7396c8b03593f9bfa1288cdebd9412ac]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:43: brick_size = 10485760<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:44: sets = 1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:45: num_bricks = 3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] INFO 2018/10/25 14:08:28 Allocating brick set #0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/brick_allocate.go:251: 0 / 3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/device_entry.go:411: expected space needed for amount=10485760 snapFactor=1 : 10539008<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/device_entry.go:368: device 6c0325d31e1b84a4f3aa088ba352e2ec[26079232] > required size [10539008] ?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/brick_allocate.go:251: 1 / 3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:455: Error detected. Cleaning up volume e8cb84a8b977a00d77e137a05a5b2530: Len(0)
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:56: No space, re-trying with smaller brick size<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:43: brick_size = 5242880<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:44: sets = 2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:45: num_bricks = 6<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] INFO 2018/10/25 14:08:28 Allocating brick set #0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/brick_allocate.go:251: 0 / 3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/device_entry.go:411: expected space needed for amount=5242880 snapFactor=1 : 5271552<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/device_entry.go:368: device bac78b5e4d558d387218d12fdfb7bfa0[26079232] > required size [5271552] ?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/brick_allocate.go:251: 1 / 3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:455: Error detected. Cleaning up volume e8cb84a8b977a00d77e137a05a5b2530: Len(0)
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:56: No space, re-trying with smaller brick size<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:43: brick_size = 2621440<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:44: sets = 4<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:45: num_bricks = 12<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] INFO 2018/10/25 14:08:28 Allocating brick set #0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/brick_allocate.go:251: 0 / 3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/device_entry.go:411: expected space needed for amount=2621440 snapFactor=1 : 2637824<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/device_entry.go:368: device 05df77bacca68b941f8d3d20d64a1aa2[94179328] > required size [2637824] ?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/brick_allocate.go:251: 1 / 3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:455: Error detected. Cleaning up volume e8cb84a8b977a00d77e137a05a5b2530: Len(0)
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:56: No space, re-trying with smaller brick size<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:43: brick_size = 1310720<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:44: sets = 8<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:45: num_bricks = 24<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] INFO 2018/10/25 14:08:28 Allocating brick set #0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/brick_allocate.go:251: 0 / 3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/device_entry.go:411: expected space needed for amount=1310720 snapFactor=1 : 1318912<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/device_entry.go:368: device 05df77bacca68b941f8d3d20d64a1aa2[94179328] > required size [1318912] ?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/brick_allocate.go:251: 1 / 3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:455: Error detected. Cleaning up volume e8cb84a8b977a00d77e137a05a5b2530: Len(0)
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:56: No space, re-trying with smaller brick size<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] ERROR 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry_allocate.go:37: Minimum brick size limit reached. Out of space.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] DEBUG 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry.go:445: Cluster 7396c8b03593f9bfa1288cdebd9412ac can not accommodate volume (Minimum brick size limit reached. Out of space.),
trying next cluster<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[heketi] ERROR 2018/10/25 14:08:28 /src/github.com/heketi/heketi/apps/glusterfs/operations_manage.go:89: Create Volume Build Failed: No space<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA">[negroni] Completed 500 Internal Server Error in 3.397009ms<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-CA" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#5B6770">This message is marked
<b>Public</b></span><span lang="EN-CA"><o:p></o:p></span></p>
<div>
<div class="MsoNormal" align="center" style="text-align:center"><span lang="EN-CA" style="mso-fareast-language:DE-AT">
<hr size="2" width="100%" align="center">
</span></div>
<p class="MsoNormal"><span lang="EN-CA" style="mso-fareast-language:DE-AT">Please consider the environment before printing this email and any attachments.<br>
<br>
This e-mail and any attachments are intended only for the individual or company to which it is addressed and may contain information which is privileged, confidential and prohibited from disclosure or unauthorized use under applicable law. If you are not the
intended recipient of this e-mail, you are hereby notified that any use, dissemination, or copying of this e-mail or the information contained in this e-mail is strictly prohibited by the sender. If you have received this transmission in error, please return
the material received to the sender and delete all copies from your system. <o:p>
</o:p></span></p>
</div>
</div>
</body>
</html>