[Gluster-users] How to enable shared_storage?

Alexandr Porunov alexandr.porunov at gmail.com
Mon Nov 21 05:43:53 UTC 2016


Version of glusterfs is 3.8.5

Here what I have installed:
rpm  -ivh
http://dl.fedoraproject.org/pub/epel/7/x86_64/e/epel-release-7-8.noarch.rpm
yum install centos-release-gluster
yum install glusterfs-server
yum install glusterfs-geo-replication

Unfortunately it doesn't work if I just add the script
"/var/lib/glusterd/hooks/1/set/post/S32gluster_enable_shared_storage.sh"
and restart "glusterd".

It seems that I have to install something else..

Sincerely,
Alexandr



On Mon, Nov 21, 2016 at 6:58 AM, Jiffin Tony Thottan <jthottan at redhat.com>
wrote:

>
> On 21/11/16 01:07, Alexandr Porunov wrote:
>
> I have installed it from rpm. No that file isn't there. The folder
> "/var/lib/glusterd/hooks/1/set/post/" is empty..
>
>
> which gluster version and what all gluster rpms have u installed?
> For time being just download this file[1] and copy to  above location and
> rerun the same cli.
>
> [1] https://github.com/gluster/glusterfs/blob/master/extras/
> hook-scripts/set/post/S32gluster_enable_shared_storage.sh
>
> --
> Jiffin
>
>
> Sincerely,
> Alexandr
>
> On Sun, Nov 20, 2016 at 2:55 PM, Jiffin Tony Thottan <jthottan at redhat.com>
> wrote:
>
>> Did u install rpm or directly from sources. Can u check whether following
>> script is present?
>> /var/lib/glusterd/hooks/1/set/post/S32gluster_enable_shared_storage.sh
>>
>> --
>>
>> Jiffin
>>
>>
>> On 20/11/16 13:33, Alexandr Porunov wrote:
>>
>> To enable shared storage I used next command:
>> # gluster volume set all cluster.enable-shared-storage enable
>>
>> But it seems that it doesn't create gluster_shared_storage automatically.
>>
>> # gluster volume status gluster_shared_storage
>> Volume gluster_shared_storage does not exist
>>
>> Do I need to manually create a volume "gluster_shared_storage"? Do I need
>> to manually create a folder "/var/run/gluster/shared_storage"? Do I need
>> to manually mount it? Or something I don't need to do?
>>
>> If I use 6 cluster nodes and I need to have a shared storage on all of
>> them then how to create a shared storage?
>> It says that it have to be with replication 2 or replication 3. But if we
>> use shared storage on all of 6 nodes then we have only 2 ways to create a
>> volume:
>> 1. Use replication 6
>> 2. Use replication 3 with distribution.
>>
>> Which way I need to use?
>>
>> Sincerely,
>> Alexandr
>>
>> On Sun, Nov 20, 2016 at 9:07 AM, Jiffin Tony Thottan <jthottan at redhat.com
>> > wrote:
>>
>>>
>>>
>>> On 19/11/16 21:47, Alexandr Porunov wrote:
>>>
>>> Unfortunately I haven't this log file but I have
>>> 'run-gluster-shared_storage.log' and it has errors I don't know why.
>>>
>>> Here is the content of the 'run-gluster-shared_storage.log':
>>>
>>>
>>> Make sure shared storage is up and running using "gluster volume status
>>> gluster_shared_storage"
>>>
>>> May be the issue is related to firewalld or iptables. Try it after
>>> disabling them.
>>>
>>> --
>>>
>>> Jiffin
>>>
>>> [2016-11-19 10:37:01.581737] I [MSGID: 100030] [glusterfsd.c:2454:main]
>>> 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.5
>>> (args: /usr/sbin/glusterfs --volfile-server=127.0.0.1
>>> --volfile-id=gluster_shared_storage /run/gluster/shared_storage)
>>> [2016-11-19 10:37:01.641836] I [MSGID: 101190]
>>> [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread
>>> with index 1
>>> [2016-11-19 10:37:01.642311] E [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk]
>>> 0-glusterfs: failed to get the 'volume file' from server
>>> [2016-11-19 10:37:01.642340] E [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk]
>>> 0-mgmt: failed to fetch volume file (key:gluster_shared_storage)
>>> [2016-11-19 10:37:01.642592] W [glusterfsd.c:1327:cleanup_and_exit]
>>> (-->/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90) [0x7f95cd309770]
>>> -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x536) [0x7f95cda3afc6]
>>> -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7f95cda34b4b] ) 0-:
>>> received signum (0), shutting down
>>> [2016-11-19 10:37:01.642638] I [fuse-bridge.c:5793:fini] 0-fuse:
>>> Unmounting '/run/gluster/shared_storage'.
>>> [2016-11-19 10:37:18.798787] I [MSGID: 100030] [glusterfsd.c:2454:main]
>>> 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.5
>>> (args: /usr/sbin/glusterfs --volfile-server=127.0.0.1
>>> --volfile-id=gluster_shared_storage /run/gluster/shared_storage)
>>> [2016-11-19 10:37:18.813011] I [MSGID: 101190]
>>> [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread
>>> with index 1
>>> [2016-11-19 10:37:18.813363] E [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk]
>>> 0-glusterfs: failed to get the 'volume file' from server
>>> [2016-11-19 10:37:18.813386] E [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk]
>>> 0-mgmt: failed to fetch volume file (key:gluster_shared_storage)
>>> [2016-11-19 10:37:18.813592] W [glusterfsd.c:1327:cleanup_and_exit]
>>> (-->/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90) [0x7f96ba4c7770]
>>> -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x536) [0x7f96babf8fc6]
>>> -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7f96babf2b4b] ) 0-:
>>> received signum (0), shutting down
>>>
>>> [2016-11-19 10:37:18.813633] I [fuse-bridge.c:5793:fini] 0-fuse:
>>> Unmounting '/run/gluster/shared_storage'.
>>> [2016-11-19 10:40:33.115685] I [MSGID: 100030] [glusterfsd.c:2454:main]
>>> 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.5
>>> (args: /usr/sbin/glusterfs --volfile-server=127.0.0.1
>>> --volfile-id=gluster_shared_storage /run/gluster/shared_storage)
>>> [2016-11-19 10:40:33.124218] I [MSGID: 101190]
>>> [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread
>>> with index 1
>>> [2016-11-19 10:40:33.124722] E [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk]
>>> 0-glusterfs: failed to get the 'volume file' from server
>>> [2016-11-19 10:40:33.124738] E [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk]
>>> 0-mgmt: failed to fetch volume file (key:gluster_shared_storage)
>>>
>>>
>>> [2016-11-19 10:40:33.124869] W [glusterfsd.c:1327:cleanup_and_exit]
>>> (-->/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90) [0x7f23576a9770]
>>> -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x536) [0x7f2357ddafc6]
>>> -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7f2357dd4b4b] ) 0-:
>>> received signum (0), shutting down
>>>
>>> [2016-11-19 10:40:33.124896] I [fuse-bridge.c:5793:fini] 0-fuse:
>>> Unmounting '/run/gluster/shared_storage'.
>>> [2016-11-19 10:44:36.029838] I [MSGID: 100030] [glusterfsd.c:2454:main]
>>> 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.5
>>> (args: /usr/sbin/glusterfs --volfile-server=127.0.0.1
>>> --volfile-id=gluster_shared_storage /run/gluster/shared_storage)
>>> [2016-11-19 10:44:36.043705] I [MSGID: 101190]
>>> [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread
>>> with index 1
>>> [2016-11-19 10:44:36.044082] E [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk]
>>> 0-glusterfs: failed to get the 'volume file' from server
>>> [2016-11-19 10:44:36.044106] E [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk]
>>> 0-mgmt: failed to fetch volume file (key:gluster_shared_storage)
>>>
>>>
>>> [2016-11-19 10:44:36.044302] W [glusterfsd.c:1327:cleanup_and_exit]
>>> (-->/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90) [0x7fbd9dced770]
>>> -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x536) [0x7fbd9e41efc6]
>>> -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7fbd9e418b4b] ) 0-:
>>> received signum (0), shutting down
>>>
>>> [2016-11-19 10:44:36.044356] I [fuse-bridge.c:5793:fini] 0-fuse:
>>> Unmounting '/run/gluster/shared_storage'.
>>>
>>> Can you help me to figure out what I am doing wrong?
>>>
>>> Sincerely,
>>> Alexandr
>>>
>>> On Sat, Nov 19, 2016 at 3:18 PM, Saravanakumar Arumugam <
>>> sarumuga at redhat.com> wrote:
>>>
>>>>
>>>>
>>>> On 11/19/2016 04:13 PM, Alexandr Porunov wrote:
>>>>
>>>> It still doesn't work..
>>>>
>>>> I have created that dir:
>>>> # mkdir -p /var/run/gluster/shared_storage
>>>>
>>>> and then:
>>>> # mount -t glusterfs 127.0.0.1:gluster_shared_storage
>>>> /var/run/gluster/shared_storage
>>>> Mount failed. Please check the log file for more details.
>>>>
>>>> Where to find a proper file to read logs? Because "/var/log/glusterfs/"
>>>> has a lot of log files.
>>>>
>>>>
>>>> You can  find mount logs like this :  "directory_mounted".log inside
>>>> /var/log/glusterfs
>>>> There is some issue in your setup...check this log and share it here.
>>>>
>>>>
>>>> Sincerely,
>>>> Alexandr
>>>>
>>>> On Sat, Nov 19, 2016 at 11:16 AM, Saravanakumar Arumugam <
>>>> sarumuga at redhat.com> wrote:
>>>>
>>>>>
>>>>> On 11/19/2016 01:39 AM, Alexandr Porunov wrote:
>>>>>
>>>>>> Hello,
>>>>>>
>>>>>> I try to enable shared storage for Geo-Replication but I am not sure
>>>>>> that I do it properly.
>>>>>>
>>>>>> Here is what I do:
>>>>>> # gluster volume set all cluster.enable-shared-storage enable
>>>>>> volume set: success
>>>>>>
>>>>>> # mount -t glusterfs 127.0.0.1:gluster_shared_storage
>>>>>> /var/run/gluster/shared_storage
>>>>>> ERROR: Mount point does not exist
>>>>>> Please specify a mount point
>>>>>> Usage:
>>>>>> man 8 /sbin/mount.glusterfs
>>>>>>
>>>>>>
>>>>>> This error means /var/run/gluster/shared_storage directory does NOT
>>>>> exists.
>>>>>
>>>>> But, running the  command (gluster volume set all
>>>>> cluster.enable-shared-storage enable)
>>>>> should carry out the mounting automatically. (so, there is no need to
>>>>> manually mount).
>>>>>
>>>>> Check after running "gluster volume set all
>>>>> cluster.enable-shared-storage enable"
>>>>>     1. gluster volume info
>>>>>      2. glusterfs process started with volfile-id as
>>>>> gluster_shared_storage.
>>>>>
>>>>> Thanks,
>>>>> Saravana
>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>>> _______________________________________________
>>> Gluster-users mailing listGluster-users at gluster.orghttp://www.gluster.org/mailman/listinfo/gluster-users
>>>
>>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20161121/15ed3564/attachment.html>


More information about the Gluster-users mailing list