I am sorry; I really didn't intend for this to be insulting. First of all, to the hard-working people who make this tool available, I want to apologize if my remarks came across as insulting or anything like that. I want it to be clear that this was not my intention. Perhaps my choice of words should have been chosen more wisely so that I gave a better indication of what I want to find out.<div>
<br></div><div>My goal of the comments was to get information if I am at a dead-end for my task. I feel that I am there. I was hoping to get feedback if others have used something else successfully. I was hoping that someone would reply to me that I am incorrect about what I am experiencing and tell me that I must have forgotten to do something or check something out. </div>
<div><br></div><div>Thank you for letting me know right away and sending me feedback.</div><div><br></div><div>-Jon</div><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Nov 24, 2012 at 7:48 PM, Joe Julian <span dir="ltr"><<a href="mailto:joe@julianfamily.org" target="_blank">joe@julianfamily.org</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div>Please don't insult the people that work hard to give you a free tool, nor those who spend their own limited time to offer you free support.<br>
<br>
If you need to try a different tool, but just do. We don't need to hear about it. <br>
<br>
If you have found a bug or have encountered a problem, ask for help if you want help. File a bug report if you want it fixed. All insults do is create frustration. <br><br><div class="gmail_quote">Jonathan Lefman <<a href="mailto:jonathan.lefman@essess.com" target="_blank">jonathan.lefman@essess.com</a>> wrote:<blockquote class="gmail_quote" style="margin:0pt 0pt 0pt 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div><div class="h5">
My gluster volume is more-or-less useless from an administration point of view. I am unable to stop the volume because it claims it is rebalancing or gluster says the command failed. When I try to stop, start, or get the status of rebalancing, I get nothing returned. I have stopped and restarted all glusterfsd processes on each host. Nothing seems to bring sanity back to the volume. <div>
<br></div><div>This is bad news for gluster's reliability. I am unable to find a source of the problem. Regular methods for resetting the system to usable state are not working. I think it is time to call it quits and find another solution. Ceph? <br>
<div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Nov 23, 2012 at 1:21 PM, Jonathan Lefman <span dir="ltr"><<a href="mailto:jonathan.lefman@essess.com" target="_blank">jonathan.lefman@essess.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">At the same time, when looking at the rebalance log, it appears that the rebalance is still going on in the background because I am seeing entries related to rebalancing. However, the detail status command shows that the distribution for files is still stable on the older nodes. <div>
<div><div>
<br></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Nov 23, 2012 at 1:10 PM, Jonathan Lefman <span dir="ltr"><<a href="mailto:jonathan.lefman@essess.com" target="_blank">jonathan.lefman@essess.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Volume type: <div><br></div><div>non-replicated, 29 nodes, xfs formats<div><br></div><div>Number of files/directories: </div>
<div><br></div><div>There are about 5000-10000 directories</div><div><br></div><div>Average size of files: </div>
<div><br></div><div>There are two distributions of files: a vast majority of files is around 200-300 kilobytes, with about 1000-fold fewer files with a size around 1 gigabyte</div></div><div><br></div><div>Average number of files per directory:</div>
<div><br></div><div>Around 1800 files per directory</div><div><br></div><div>glusterd log below:</div><div><br></div><div>When trying</div><div><br></div><div>sudo gluster volume rebalance essess_data status<br></div><div>
<br></div><div>OR</div><div><br></div><div>sudo gluster volume status myvol</div><div>operation failed<br></div><div><br></div><div>Log for this time from /var/log/glusterfs/etc-glusterfs-glusterd.vol.log:</div><div><br>
</div>
<div><div>[2012-11-23 13:05:00.489567] E [glusterd-handler.c:458:glusterd_op_txn_begin] 0-management: Unable to acquire local lock, ret: -1</div><div>[2012-11-23 13:07:09.102007] I [glusterd-handler.c:2670:glusterd_handle_status_volume] 0-management: Received status volume req for volume essess_data</div>
<div>[2012-11-23 13:07:09.102056] E [glusterd-utils.c:277:glusterd_lock] 0-glusterd: Unable to get lock for uuid: ee33fd05-135e-40e7-a157-3c1e0b9be073, lock held by: ee33fd05-135e-40e7-a157-3c1e0b9be073</div><div>[2012-11-23 13:07:09.102073] E [glusterd-handler.c:458:glusterd_op_txn_begin] 0-management: Unable to acquire local lock, ret: -1</div>
</div><div><br></div><div><br></div><div class="gmail_extra"><div><div><br><br><div class="gmail_quote">On Fri, Nov 23, 2012 at 12:58 PM, Vijay Bellur <span dir="ltr"><<a href="mailto:vbellur@redhat.com" target="_blank">vbellur@redhat.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div>On 11/23/2012 11:14 PM, Jonathan Lefman wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
The rebalance command has run for quite a while. Now when I issue the<br>
rebalance status command,<br>
<br>
sudo gluster volume rebalance myvol status<br>
<br>
I get nothing back; just a return to the command prompt. Any ideas of<br>
what is going on?<br>
<br>
</blockquote>
<br></div>
A few questions:<br>
<br>
- What is your volume type?<br>
- How many files and directories do you have in your volume?<br>
- What is the average size of files?<br>
- What is the average number of files per directory?<br>
- Can you please share glusterd logs from the time when the command returns without displaying any output?<br>
<br>
Thanks,<br>
Vijay<br>
<br>
</blockquote></div><br><br clear="all"><div><br></div></div></div><div>--</div></div></blockquote></div></div></div></div></blockquote></div><br clear="all"><div><br></div></div></div></div></div><div class="im"><pre style="white-space:pre-wrap;word-wrap:break-word;font-family:sans-serif;margin-top:0px">
Gluster-users mailing list<br><a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br><a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></pre>
</div></blockquote></div></div></div></blockquote></div><br>
</div>