[Gluster-users] How to enable shared_storage?

Jiffin Tony Thottan jthottan at redhat.com
Mon Nov 21 07:02:58 UTC 2016



On 21/11/16 11:13, Alexandr Porunov wrote:
> Version of glusterfs is 3.8.5
>
> Here what I have installed:
> rpm  -ivh 
> http://dl.fedoraproject.org/pub/epel/7/x86_64/e/epel-release-7-8.noarch.rpm
> yum install centos-release-gluster
> yum install glusterfs-server

It should be part of glusterfs-server. So can u check files provided by 
this, run rpm -qil <full name of glusterfs-server rpm>

> yum install glusterfs-geo-replication
>
> Unfortunately it doesn't work if I just add the script 
> "/var/lib/glusterd/hooks/1/set/post/S32gluster_enable_shared_storage.sh" 
> and restart "glusterd".
>

I didn't get that, when u rerun gluster v set all 
cluster.enable-shared-storage enable should work (I guess even glusterd 
restart is not required)
Or do u have any volumes named "gluster_shared_storage", if yes please 
remove it and rerun the cli.

--
Jiffin

> It seems that I have to install something else..
>
> Sincerely,
> Alexandr
>
>
>
> On Mon, Nov 21, 2016 at 6:58 AM, Jiffin Tony Thottan 
> <jthottan at redhat.com <mailto:jthottan at redhat.com>> wrote:
>
>
>     On 21/11/16 01:07, Alexandr Porunov wrote:
>>     I have installed it from rpm. No that file isn't there. The
>>     folder "/var/lib/glusterd/hooks/1/set/post/" is empty..
>>
>
>     which gluster version and what all gluster rpms have u installed?
>     For time being just download this file[1] and copy to above
>     location and rerun the same cli.
>
>     [1]
>     https://github.com/gluster/glusterfs/blob/master/extras/hook-scripts/set/post/S32gluster_enable_shared_storage.sh
>     <https://github.com/gluster/glusterfs/blob/master/extras/hook-scripts/set/post/S32gluster_enable_shared_storage.sh>
>
>     --
>     Jiffin
>
>
>>     Sincerely,
>>     Alexandr
>>
>>     On Sun, Nov 20, 2016 at 2:55 PM, Jiffin Tony Thottan
>>     <jthottan at redhat.com <mailto:jthottan at redhat.com>> wrote:
>>
>>         Did u install rpm or directly from sources. Can u check
>>         whether following script is present?
>>
>>         /var/lib/glusterd/hooks/1/set/post/S32gluster_enable_shared_storage.sh
>>
>>         --
>>
>>         Jiffin
>>
>>
>>         On 20/11/16 13:33, Alexandr Porunov wrote:
>>>         To enable shared storage I used next command:
>>>         # gluster volume set all cluster.enable-shared-storage enable
>>>
>>>         But it seems that it doesn't create gluster_shared_storage
>>>         automatically.
>>>
>>>         # gluster volume status gluster_shared_storage
>>>         Volume gluster_shared_storage does not exist
>>>
>>>         Do I need to manually create a volume
>>>         "gluster_shared_storage"? Do I need to manually create a
>>>         folder "/var/run/gluster/shared_storage"? Do I need to
>>>         manually mount it? Or something I don't need to do?
>>>
>>>         If I use 6 cluster nodes and I need to have a shared storage
>>>         on all of them then how to create a shared storage?
>>>         It says that it have to be with replication 2 or replication
>>>         3. But if we use shared storage on all of 6 nodes then we
>>>         have only 2 ways to create a volume:
>>>         1. Use replication 6
>>>         2. Use replication 3 with distribution.
>>>
>>>         Which way I need to use?
>>>
>>>         Sincerely,
>>>         Alexandr
>>>
>>>         On Sun, Nov 20, 2016 at 9:07 AM, Jiffin Tony Thottan
>>>         <jthottan at redhat.com <mailto:jthottan at redhat.com>> wrote:
>>>
>>>
>>>
>>>             On 19/11/16 21:47, Alexandr Porunov wrote:
>>>>             Unfortunately I haven't this log file but I have
>>>>             'run-gluster-shared_storage.log' and it has errors I
>>>>             don't know why.
>>>>
>>>>             Here is the content of the
>>>>             'run-gluster-shared_storage.log':
>>>>
>>>
>>>             Make sure shared storage is up and running using
>>>             "gluster volume status gluster_shared_storage"
>>>
>>>             May be the issue is related to firewalld or iptables.
>>>             Try it after disabling them.
>>>
>>>             --
>>>
>>>             Jiffin
>>>>             [2016-11-19 10:37:01.581737] I [MSGID: 100030]
>>>>             [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started
>>>>             running /usr/sbin/glusterfs version 3.8.5 (args:
>>>>             /usr/sbin/glusterfs --volfile-server=127.0.0.1
>>>>             --volfile-id=gluster_shared_storage
>>>>             /run/gluster/shared_storage)
>>>>             [2016-11-19 10:37:01.641836] I [MSGID: 101190]
>>>>             [event-epoll.c:628:event_dispatch_epoll_worker]
>>>>             0-epoll: Started thread with index 1
>>>>             [2016-11-19 10:37:01.642311] E
>>>>             [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk] 0-glusterfs:
>>>>             failed to get the 'volume file' from server
>>>>             [2016-11-19 10:37:01.642340] E
>>>>             [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk] 0-mgmt:
>>>>             failed to fetch volume file (key:gluster_shared_storage)
>>>>             [2016-11-19 10:37:01.642592] W
>>>>             [glusterfsd.c:1327:cleanup_and_exit]
>>>>             (-->/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90)
>>>>             [0x7f95cd309770]
>>>>             -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x536)
>>>>             [0x7f95cda3afc6]
>>>>             -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b)
>>>>             [0x7f95cda34b4b] ) 0-: received signum (0), shutting down
>>>>             [2016-11-19 10:37:01.642638] I
>>>>             [fuse-bridge.c:5793:fini] 0-fuse: Unmounting
>>>>             '/run/gluster/shared_storage'.
>>>>             [2016-11-19 10:37:18.798787] I [MSGID: 100030]
>>>>             [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started
>>>>             running /usr/sbin/glusterfs version 3.8.5 (args:
>>>>             /usr/sbin/glusterfs --volfile-server=127.0.0.1
>>>>             --volfile-id=gluster_shared_storage
>>>>             /run/gluster/shared_storage)
>>>>             [2016-11-19 10:37:18.813011] I [MSGID: 101190]
>>>>             [event-epoll.c:628:event_dispatch_epoll_worker]
>>>>             0-epoll: Started thread with index 1
>>>>             [2016-11-19 10:37:18.813363] E
>>>>             [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk] 0-glusterfs:
>>>>             failed to get the 'volume file' from server
>>>>             [2016-11-19 10:37:18.813386] E
>>>>             [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk] 0-mgmt:
>>>>             failed to fetch volume file (key:gluster_shared_storage)
>>>>             [2016-11-19 10:37:18.813592] W
>>>>             [glusterfsd.c:1327:cleanup_and_exit]
>>>>             (-->/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90)
>>>>             [0x7f96ba4c7770]
>>>>             -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x536)
>>>>             [0x7f96babf8fc6]
>>>>             -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b)
>>>>             [0x7f96babf2b4b] ) 0-: received signum (0), shutting down
>>>>             [2016-11-19 10:37:18.813633] I
>>>>             [fuse-bridge.c:5793:fini] 0-fuse: Unmounting
>>>>             '/run/gluster/shared_storage'.
>>>>             [2016-11-19 10:40:33.115685] I [MSGID: 100030]
>>>>             [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started
>>>>             running /usr/sbin/glusterfs version 3.8.5 (args:
>>>>             /usr/sbin/glusterfs --volfile-server=127.0.0.1
>>>>             --volfile-id=gluster_shared_storage
>>>>             /run/gluster/shared_storage)
>>>>             [2016-11-19 10:40:33.124218] I [MSGID: 101190]
>>>>             [event-epoll.c:628:event_dispatch_epoll_worker]
>>>>             0-epoll: Started thread with index 1
>>>>             [2016-11-19 10:40:33.124722] E
>>>>             [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk] 0-glusterfs:
>>>>             failed to get the 'volume file' from server
>>>>             [2016-11-19 10:40:33.124738] E
>>>>             [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk] 0-mgmt:
>>>>             failed to fetch volume file (key:gluster_shared_storage)
>>>>             [2016-11-19 10:40:33.124869] W
>>>>             [glusterfsd.c:1327:cleanup_and_exit]
>>>>             (-->/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90)
>>>>             [0x7f23576a9770]
>>>>             -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x536)
>>>>             [0x7f2357ddafc6]
>>>>             -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b)
>>>>             [0x7f2357dd4b4b] ) 0-: received signum (0), shutting down
>>>>             [2016-11-19 10:40:33.124896] I
>>>>             [fuse-bridge.c:5793:fini] 0-fuse: Unmounting
>>>>             '/run/gluster/shared_storage'.
>>>>             [2016-11-19 10:44:36.029838] I [MSGID: 100030]
>>>>             [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started
>>>>             running /usr/sbin/glusterfs version 3.8.5 (args:
>>>>             /usr/sbin/glusterfs --volfile-server=127.0.0.1
>>>>             --volfile-id=gluster_shared_storage
>>>>             /run/gluster/shared_storage)
>>>>             [2016-11-19 10:44:36.043705] I [MSGID: 101190]
>>>>             [event-epoll.c:628:event_dispatch_epoll_worker]
>>>>             0-epoll: Started thread with index 1
>>>>             [2016-11-19 10:44:36.044082] E
>>>>             [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk] 0-glusterfs:
>>>>             failed to get the 'volume file' from server
>>>>             [2016-11-19 10:44:36.044106] E
>>>>             [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk] 0-mgmt:
>>>>             failed to fetch volume file (key:gluster_shared_storage)
>>>>             [2016-11-19 10:44:36.044302] W
>>>>             [glusterfsd.c:1327:cleanup_and_exit]
>>>>             (-->/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90)
>>>>             [0x7fbd9dced770]
>>>>             -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x536)
>>>>             [0x7fbd9e41efc6]
>>>>             -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b)
>>>>             [0x7fbd9e418b4b] ) 0-: received signum (0), shutting down
>>>>             [2016-11-19 10:44:36.044356] I
>>>>             [fuse-bridge.c:5793:fini] 0-fuse: Unmounting
>>>>             '/run/gluster/shared_storage'.
>>>>
>>>>             Can you help me to figure out what I am doing wrong?
>>>>
>>>>             Sincerely,
>>>>             Alexandr
>>>>
>>>>             On Sat, Nov 19, 2016 at 3:18 PM, Saravanakumar Arumugam
>>>>             <sarumuga at redhat.com <mailto:sarumuga at redhat.com>> wrote:
>>>>
>>>>
>>>>
>>>>                 On 11/19/2016 04:13 PM, Alexandr Porunov wrote:
>>>>>                 It still doesn't work..
>>>>>
>>>>>                 I have created that dir:
>>>>>                 # mkdir -p /var/run/gluster/shared_storage
>>>>>
>>>>>                 and then:
>>>>>                 # mount -t glusterfs
>>>>>                 127.0.0.1:gluster_shared_storage
>>>>>                 /var/run/gluster/shared_storage
>>>>>                 Mount failed. Please check the log file for more
>>>>>                 details.
>>>>>
>>>>>                 Where to find a proper file to read logs? Because
>>>>>                 "/var/log/glusterfs/" has a lot of log files.
>>>>
>>>>                 You can find mount logs like this :
>>>>                 "directory_mounted".log inside /var/log/glusterfs
>>>>                 There is some issue in your setup...check this log
>>>>                 and share it here.
>>>>>
>>>>>                 Sincerely,
>>>>>                 Alexandr
>>>>>
>>>>>                 On Sat, Nov 19, 2016 at 11:16 AM, Saravanakumar
>>>>>                 Arumugam <sarumuga at redhat.com
>>>>>                 <mailto:sarumuga at redhat.com>> wrote:
>>>>>
>>>>>
>>>>>                     On 11/19/2016 01:39 AM, Alexandr Porunov wrote:
>>>>>
>>>>>                         Hello,
>>>>>
>>>>>                         I try to enable shared storage for
>>>>>                         Geo-Replication but I am not sure that I
>>>>>                         do it properly.
>>>>>
>>>>>                         Here is what I do:
>>>>>                         # gluster volume set all
>>>>>                         cluster.enable-shared-storage enable
>>>>>                         volume set: success
>>>>>
>>>>>                         # mount -t glusterfs
>>>>>                         127.0.0.1:gluster_shared_storage
>>>>>                         /var/run/gluster/shared_storage
>>>>>                         ERROR: Mount point does not exist
>>>>>                         Please specify a mount point
>>>>>                         Usage:
>>>>>                         man 8 /sbin/mount.glusterfs
>>>>>
>>>>>
>>>>>                     This error means
>>>>>                     /var/run/gluster/shared_storage directory does
>>>>>                     NOT exists.
>>>>>
>>>>>                     But, running the  command (gluster volume set
>>>>>                     all cluster.enable-shared-storage enable)
>>>>>                     should carry out the mounting automatically.
>>>>>                     (so, there is no need to manually mount).
>>>>>
>>>>>                     Check after running "gluster volume set all
>>>>>                     cluster.enable-shared-storage enable"
>>>>>                         1. gluster volume info
>>>>>                          2. glusterfs process started with
>>>>>                     volfile-id as gluster_shared_storage.
>>>>>
>>>>>                     Thanks,
>>>>>                     Saravana
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>>
>>>>             _______________________________________________
>>>>             Gluster-users mailing list
>>>>             Gluster-users at gluster.org
>>>>             <mailto:Gluster-users at gluster.org>
>>>>             http://www.gluster.org/mailman/listinfo/gluster-users
>>>>             <http://www.gluster.org/mailman/listinfo/gluster-users>
>>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20161121/89d7d46a/attachment.html>


More information about the Gluster-users mailing list