[Gluster-users] samba client gets mount error(5): Input/output error

Discussion:

Christos Tsalidis

2018-10-09 13:12:09 UTC

Hi all,

I am testing the samba client in glusterfs 3.12.14 version on CentOS Linux
release 7.5.1804 and getting a mount error(5): Input/output error.

[***@workstation ~]# mount /mnt/smbdata
mount error(5): Input/output error
Refer to the mount.cifs(8) manual page (e.g. man mount.cifs)
[***@workstation ~]# cat /etc/fstab | grep smbdata
//servera.lab.local/gluster-mastervol /mnt/smbdata cifs
user=smbuser,pass=redhat 0 0
[***@workstation ~]# rpm -q cifs-utils
cifs-utils-6.2-10.el7.x86_64

cat /var/log/messages

Oct 9 13:50:33 workstation kernel: CIFS VFS: cifs_mount failed w/return
code = -5
Oct 9 13:50:53 workstation kernel: CIFS VFS: cifs_mount failed w/return
code = -5
Oct 9 13:51:49 workstation kernel: CIFS VFS: cifs_mount failed w/return
code = -5
Oct 9 13:52:06 workstation kernel: CIFS VFS: cifs_mount failed w/return
code = -5
Oct 9 14:01:02 workstation systemd: Created slice User Slice of root.
Oct 9 14:01:02 workstation systemd: Starting User Slice of root.
Oct 9 14:01:02 workstation systemd: Started Session 4 of user root.
Oct 9 14:01:02 workstation systemd: Starting Session 4 of user root.
Oct 9 14:01:02 workstation systemd: Removed slice User Slice of root.
Oct 9 14:01:02 workstation systemd: Stopping User Slice of root.
Oct 9 14:34:54 workstation kernel: CIFS VFS: cifs_mount failed w/return
code = -5
Oct 9 14:36:02 workstation kernel: CIFS VFS: cifs_mount failed w/return
code = -5

[***@servera ~]# systemctl status smb
â smb.service - Samba SMB Daemon
Loaded: loaded (/usr/lib/systemd/system/smb.service; enabled; vendor
preset: disabled)
Active: active (running) since Tue 2018-10-09 13:28:48 CEST; 53min ago
Main PID: 18707 (smbd)
Status: "smbd: ready to serve connections..."
CGroup: /system.slice/smb.service
ââ18707 /usr/sbin/smbd --foreground --no-process-group
ââ18709 /usr/sbin/smbd --foreground --no-process-group
ââ18710 /usr/sbin/smbd --foreground --no-process-group
ââ18711 /usr/sbin/smbd --foreground --no-process-group

Oct 09 13:35:49 servera.lab.local smbd[18986]: [2018/10/09
13:35:49.774640, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)
Oct 09 13:35:49 servera.lab.local smbd[18986]: mastervol: Failed to
initialize volume (Transport endpoint is not connected)
Oct 09 13:36:46 servera.lab.local smbd[18997]: [2018/10/09
13:36:46.098201, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)
Oct 09 13:36:46 servera.lab.local smbd[18997]: mastervol: Failed to
initialize volume (Transport endpoint is not connected)
Oct 09 13:37:03 servera.lab.local smbd[19036]: [2018/10/09
13:37:03.470317, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)
Oct 09 13:37:03 servera.lab.local smbd[19036]: mastervol: Failed to
initialize volume (Transport endpoint is not connected)
Oct 09 14:19:51 servera.lab.local smbd[19075]: [2018/10/09
14:19:51.273307, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)
Oct 09 14:19:51 servera.lab.local smbd[19075]: mastervol: Failed to
initialize volume (Transport endpoint is not connected)
Oct 09 14:20:59 servera.lab.local smbd[19085]: [2018/10/09
14:20:59.726227, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)
Oct 09 14:20:59 servera.lab.local smbd[19085]: mastervol: Failed to
initialize volume (Transport endpoint is not connected)
Hint: Some lines were ellipsized, use -l to show in full.
[***@servera ~]# gluster volume info mastervol

Volume Name: mastervol
Type: Distribute
Volume ID: f6bfe62f-068d-4ade-8d47-ee2e61418804
Status: Started
Snapshot Count: 0
Number of Bricks: 2
Transport-type: tcp
Bricks:
Brick1: servera:/bricks/brick-a1/brick
Brick2: serverb:/bricks/brick-b1/brick
Options Reconfigured:
storage.batch-fsync-delay-usec: 0
server.allow-insecure: on
performance.stat-prefetch: off
transport.address-family: inet
nfs.disable: off
[***@servera ~]# gluster volume status mastervol
Status of volume: mastervol
Gluster process TCP Port RDMA Port Online Pid
------------------------------------------------------------------------------
Brick servera:/bricks/brick-a1/brick 49153 0 Y
18904
Brick serverb:/bricks/brick-b1/brick 49153 0 Y
9654
NFS Server on localhost 2049 0 Y
19024
NFS Server on serverb.lab.local 2049 0 Y
9675

Task Status of Volume mastervol
------------------------------------------------------------------------------
There are no active volume tasks

[***@servera ~]# firewall-cmd --list-services
ssh dhcpv6-client glusterfs nfs rpc-bind samba

[***@servera ~]# cat /etc/passwd | grep smbuser
smbuser:x:1001:1001::/home/smbuser:/sbin/nologin

[***@servera ~]# cat /etc/samba/smb.conf
# See smb.conf.example for a more detailed config file or
# read the smb.conf manpage.
# Run 'testparm' to verify the config is correct after
# you modified it.

[global]
workgroup = SAMBA
security = user

passdb backend = tdbsam

printing = cups
printcap name = cups
load printers = yes
cups options = raw

[homes]
comment = Home Directories
valid users = %S, %D%w%S
browseable = No
read only = No
inherit acls = Yes

[printers]
comment = All Printers
path = /var/tmp
printable = Yes
create mask = 0600
browseable = No

[print$]
comment = Printer Drivers
path = /var/lib/samba/drivers
write list = @printadmin root
force group = @printadmin
create mask = 0664
directory mask = 0775

[gluster-mastervol]
comment = For samba share of volume mastervol
vfs objects = glusterfs
glusterfs:volume = mastervol
glusterfs:logfile = /var/log/samba/glusterfs-mastervol.%M.log
glusterfs:loglevel = 7
path = /
read only = no
guest ok = yes

[***@servera ~]# cat /var/log/samba/glusterfs-mastervol.10.0.2.20.log
[2018-10-09 11:35:25.955750] W [MSGID: 101002]
[options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is
deprecated, preferred is 'transport.address-family', continuing with
correction
[2018-10-09 11:35:25.966487] E [socket.c:3295:socket_connect] 0-gfapi:
connection attempt on failed, (Permission denied)
[2018-10-09 11:35:25.966861] I [MSGID: 104024]
[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
[2018-10-09 11:35:29.969343] E [socket.c:3295:socket_connect] 0-gfapi:
connection attempt on failed, (Permission denied)
[2018-10-09 11:35:29.969551] I [MSGID: 104025]
[glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile
servers [Transport endpoint is not connected]
[2018-10-09 11:35:29.971484] I [MSGID: 101191]
[event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with
index 1
[2018-10-09 11:35:29.969550] I [MSGID: 104024]
[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
[2018-10-09 11:35:29.971734] I [timer.c:89:gf_timer_call_cancel]
(-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938]
-->/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x33)
[0x7f5d7ab08903] -->/lib64/libglusterfs.so.0(gf_timer_call_cancel+0x179)
[0x7f5d7ab137f9] ) 0-timer: ctx cleanup started
[2018-10-09 11:35:46.758283] W [MSGID: 101002]
[options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is
deprecated, preferred is 'transport.address-family', continuing with
correction
[2018-10-09 11:35:46.768809] E [socket.c:3295:socket_connect] 0-gfapi:
connection attempt on failed, (Permission denied)
[2018-10-09 11:35:46.769146] I [MSGID: 104024]
[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
[2018-10-09 11:35:49.774441] E [socket.c:3295:socket_connect] 0-gfapi:
connection attempt on failed, (Permission denied)
[2018-10-09 11:35:49.774597] I [MSGID: 104025]
[glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile
servers [Transport endpoint is not connected]
[2018-10-09 11:35:49.776114] I [MSGID: 101191]
[event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with
index 1
[2018-10-09 11:35:49.774595] I [MSGID: 104024]
[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
[2018-10-09 11:35:49.776381] I [timer.c:89:gf_timer_call_cancel]
(-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938]
-->/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x33)
[0x7f5d7ab08903] -->/lib64/libglusterfs.so.0(gf_timer_call_cancel+0x179)
[0x7f5d7ab137f9] ) 0-timer: ctx cleanup started
[2018-10-09 11:36:43.084797] W [MSGID: 101002]
[options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is
deprecated, preferred is 'transport.address-family', continuing with
correction
[2018-10-09 11:36:43.093954] E [socket.c:3295:socket_connect] 0-gfapi:
connection attempt on failed, (Permission denied)
[2018-10-09 11:36:43.094242] I [MSGID: 104024]
[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
[2018-10-09 11:36:46.098039] E [socket.c:3295:socket_connect] 0-gfapi:
connection attempt on failed, (Permission denied)
[2018-10-09 11:36:46.098160] I [MSGID: 104025]
[glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile
servers [Transport endpoint is not connected]
[2018-10-09 11:36:46.099301] I [MSGID: 101191]
[event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with
index 1
[2018-10-09 11:36:46.098158] I [MSGID: 104024]
[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
[2018-10-09 11:36:46.099661] I [timer.c:89:gf_timer_call_cancel]
(-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938]
-->/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x33)
[0x7f5d7ab08903] -->/lib64/libglusterfs.so.0(gf_timer_call_cancel+0x179)
[0x7f5d7ab137f9] ) 0-timer: ctx cleanup started
[2018-10-09 11:37:00.456669] W [MSGID: 101002]
[options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is
deprecated, preferred is 'transport.address-family', continuing with
correction
[2018-10-09 11:37:00.466135] E [socket.c:3295:socket_connect] 0-gfapi:
connection attempt on failed, (Permission denied)
[2018-10-09 11:37:00.466323] I [MSGID: 104024]
[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
[2018-10-09 11:37:03.470127] E [socket.c:3295:socket_connect] 0-gfapi:
connection attempt on failed, (Permission denied)
[2018-10-09 11:37:03.470275] I [MSGID: 104025]
[glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile
servers [Transport endpoint is not connected]
[2018-10-09 11:37:03.471773] I [MSGID: 101191]
[event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with
index 1
[2018-10-09 11:37:03.470274] I [MSGID: 104024]
[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
[2018-10-09 11:37:03.472038] I [timer.c:89:gf_timer_call_cancel]
(-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938]
-->/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x33)
[0x7f5d7ab08903] -->/lib64/libglusterfs.so.0(gf_timer_call_cancel+0x179)
[0x7f5d7ab137f9] ) 0-timer: ctx cleanup started
[2018-10-09 12:19:48.258100] W [MSGID: 101002]
[options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is
deprecated, preferred is 'transport.address-family', continuing with
correction
[2018-10-09 12:19:48.267722] E [socket.c:3295:socket_connect] 0-gfapi:
connection attempt on failed, (Permission denied)
[2018-10-09 12:19:48.268239] I [MSGID: 104024]
[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
[2018-10-09 12:19:51.273134] E [socket.c:3295:socket_connect] 0-gfapi:
connection attempt on failed, (Permission denied)
[2018-10-09 12:19:51.273266] I [MSGID: 104025]
[glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile
servers [Transport endpoint is not connected]
[2018-10-09 12:19:51.275239] I [MSGID: 101191]
[event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with
index 1
[2018-10-09 12:19:51.273265] I [MSGID: 104024]
[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
[2018-10-09 12:19:51.275492] I [timer.c:89:gf_timer_call_cancel]
(-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938]
-->/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x33)
[0x7f5d7ab08903] -->/lib64/libglusterfs.so.0(gf_timer_call_cancel+0x179)
[0x7f5d7ab137f9] ) 0-timer: ctx cleanup started
[2018-10-09 12:20:56.711327] W [MSGID: 101002]
[options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is
deprecated, preferred is 'transport.address-family', continuing with
correction
[2018-10-09 12:20:56.720534] E [socket.c:3295:socket_connect] 0-gfapi:
connection attempt on failed, (Permission denied)
[2018-10-09 12:20:56.720810] I [MSGID: 104024]
[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
[2018-10-09 12:20:59.726063] E [socket.c:3295:socket_connect] 0-gfapi:
connection attempt on failed, (Permission denied)
[2018-10-09 12:20:59.726187] I [MSGID: 104025]
[glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile
servers [Transport endpoint is not connected]
[2018-10-09 12:20:59.727301] I [MSGID: 101191]
[event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with
index 1
[2018-10-09 12:20:59.726186] I [MSGID: 104024]
[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
[2018-10-09 12:20:59.727643] I [timer.c:89:gf_timer_call_cancel]
(-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938]
-->/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x33)
[0x7f5d7ab08903] -->/lib64/libglusterfs.so.0(gf_timer_call_cancel+0x179)
[0x7f5d7ab137f9] ) 0-timer: ctx cleanup started

Do you have any idea how can I solve this?

Thanks in advance!

Diego Remolina

2018-10-09 13:21:12 UTC

Permalink

Per: https://www.samba.org/samba/docs/current/man-html/vfs_glusterfs.8.html

Does adding: kernel share modes = no
to smb.conf and restarting samba helps?

FWIW, I have had many recent problems using the samba vfs plugins on
Centos 7.5 (latest) against a 3.10.x glusterfs server. When exporting
via samba and using vfs objects = glusterfs many different programs
have i/o errors specially when trying to save files.

Some specific files (Autodesk Revit files) present problem reading.

My current workaround for regular operation has been using a fuse
mount and sharing directly from it via samba. So commented out all the
vfs objects and gluster related configurations and exported the
locally fuse mounted directory.

Post by Christos Tsalidis
Hi all,
I am testing the samba client in glusterfs 3.12.14 version on CentOS Linux release 7.5.1804 and getting a mount error(5): Input/output error.
mount error(5): Input/output error
Refer to the mount.cifs(8) manual page (e.g. man mount.cifs)
//servera.lab.local/gluster-mastervol /mnt/smbdata cifs user=smbuser,pass=redhat 0 0
cifs-utils-6.2-10.el7.x86_64
cat /var/log/messages
Oct 9 13:50:33 workstation kernel: CIFS VFS: cifs_mount failed w/return code = -5
Oct 9 13:50:53 workstation kernel: CIFS VFS: cifs_mount failed w/return code = -5
Oct 9 13:51:49 workstation kernel: CIFS VFS: cifs_mount failed w/return code = -5
Oct 9 13:52:06 workstation kernel: CIFS VFS: cifs_mount failed w/return code = -5
Oct 9 14:01:02 workstation systemd: Created slice User Slice of root.
Oct 9 14:01:02 workstation systemd: Starting User Slice of root.
Oct 9 14:01:02 workstation systemd: Started Session 4 of user root.
Oct 9 14:01:02 workstation systemd: Starting Session 4 of user root.
Oct 9 14:01:02 workstation systemd: Removed slice User Slice of root.
Oct 9 14:01:02 workstation systemd: Stopping User Slice of root.
Oct 9 14:34:54 workstation kernel: CIFS VFS: cifs_mount failed w/return code = -5
Oct 9 14:36:02 workstation kernel: CIFS VFS: cifs_mount failed w/return code = -5
● smb.service - Samba SMB Daemon
Loaded: loaded (/usr/lib/systemd/system/smb.service; enabled; vendor preset: disabled)
Active: active (running) since Tue 2018-10-09 13:28:48 CEST; 53min ago
Main PID: 18707 (smbd)
Status: "smbd: ready to serve connections..."
CGroup: /system.slice/smb.service
├─18707 /usr/sbin/smbd --foreground --no-process-group
├─18709 /usr/sbin/smbd --foreground --no-process-group
├─18710 /usr/sbin/smbd --foreground --no-process-group
└─18711 /usr/sbin/smbd --foreground --no-process-group
Oct 09 13:35:49 servera.lab.local smbd[18986]: [2018/10/09 13:35:49.774640, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)
Oct 09 13:35:49 servera.lab.local smbd[18986]: mastervol: Failed to initialize volume (Transport endpoint is not connected)
Oct 09 13:36:46 servera.lab.local smbd[18997]: [2018/10/09 13:36:46.098201, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)
Oct 09 13:36:46 servera.lab.local smbd[18997]: mastervol: Failed to initialize volume (Transport endpoint is not connected)
Oct 09 13:37:03 servera.lab.local smbd[19036]: [2018/10/09 13:37:03.470317, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)
Oct 09 13:37:03 servera.lab.local smbd[19036]: mastervol: Failed to initialize volume (Transport endpoint is not connected)
Oct 09 14:19:51 servera.lab.local smbd[19075]: [2018/10/09 14:19:51.273307, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)
Oct 09 14:19:51 servera.lab.local smbd[19075]: mastervol: Failed to initialize volume (Transport endpoint is not connected)
Oct 09 14:20:59 servera.lab.local smbd[19085]: [2018/10/09 14:20:59.726227, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)
Oct 09 14:20:59 servera.lab.local smbd[19085]: mastervol: Failed to initialize volume (Transport endpoint is not connected)
Hint: Some lines were ellipsized, use -l to show in full.
Volume Name: mastervol
Type: Distribute
Volume ID: f6bfe62f-068d-4ade-8d47-ee2e61418804
Status: Started
Snapshot Count: 0
Number of Bricks: 2
Transport-type: tcp
Brick1: servera:/bricks/brick-a1/brick
Brick2: serverb:/bricks/brick-b1/brick
storage.batch-fsync-delay-usec: 0
server.allow-insecure: on
performance.stat-prefetch: off
transport.address-family: inet
nfs.disable: off
Status of volume: mastervol
Gluster process TCP Port RDMA Port Online Pid
------------------------------------------------------------------------------
Brick servera:/bricks/brick-a1/brick 49153 0 Y 18904
Brick serverb:/bricks/brick-b1/brick 49153 0 Y 9654
NFS Server on localhost 2049 0 Y 19024
NFS Server on serverb.lab.local 2049 0 Y 9675
Task Status of Volume mastervol
------------------------------------------------------------------------------
There are no active volume tasks
ssh dhcpv6-client glusterfs nfs rpc-bind samba
smbuser:x:1001:1001::/home/smbuser:/sbin/nologin
# See smb.conf.example for a more detailed config file or
# read the smb.conf manpage.
# Run 'testparm' to verify the config is correct after
# you modified it.
[global]
workgroup = SAMBA
security = user
passdb backend = tdbsam
printing = cups
printcap name = cups
load printers = yes
cups options = raw
[homes]
comment = Home Directories
valid users = %S, %D%w%S
browseable = No
read only = No
inherit acls = Yes
[printers]
comment = All Printers
path = /var/tmp
printable = Yes
create mask = 0600
browseable = No
[print$]
comment = Printer Drivers
path = /var/lib/samba/drivers
create mask = 0664
directory mask = 0775
[gluster-mastervol]
comment = For samba share of volume mastervol
vfs objects = glusterfs
glusterfs:volume = mastervol
glusterfs:logfile = /var/log/samba/glusterfs-mastervol.%M.log
glusterfs:loglevel = 7
path = /
read only = no
guest ok = yes
[2018-10-09 11:35:25.955750] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction
[2018-10-09 11:35:25.966487] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on failed, (Permission denied)
[2018-10-09 11:35:25.966861] I [MSGID: 104024] [glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from remote-host: localhost
[2018-10-09 11:35:29.969343] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on failed, (Permission denied)
[2018-10-09 11:35:29.969551] I [MSGID: 104025] [glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile servers [Transport endpoint is not connected]
[2018-10-09 11:35:29.971484] I [MSGID: 101191] [event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with index 1
[2018-10-09 11:35:29.969550] I [MSGID: 104024] [glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from remote-host: localhost
[2018-10-09 11:35:29.971734] I [timer.c:89:gf_timer_call_cancel] (-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938] -->/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x33) [0x7f5d7ab08903] -->/lib64/libglusterfs.so.0(gf_timer_call_cancel+0x179) [0x7f5d7ab137f9] ) 0-timer: ctx cleanup started
[2018-10-09 11:35:46.758283] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction
[2018-10-09 11:35:46.768809] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on failed, (Permission denied)
[2018-10-09 11:35:46.769146] I [MSGID: 104024] [glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from remote-host: localhost
[2018-10-09 11:35:49.774441] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on failed, (Permission denied)
[2018-10-09 11:35:49.774597] I [MSGID: 104025] [glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile servers [Transport endpoint is not connected]
[2018-10-09 11:35:49.776114] I [MSGID: 101191] [event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with index 1
[2018-10-09 11:35:49.774595] I [MSGID: 104024] [glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from remote-host: localhost
[2018-10-09 11:35:49.776381] I [timer.c:89:gf_timer_call_cancel] (-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938] -->/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x33) [0x7f5d7ab08903] -->/lib64/libglusterfs.so.0(gf_timer_call_cancel+0x179) [0x7f5d7ab137f9] ) 0-timer: ctx cleanup started
[2018-10-09 11:36:43.084797] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction
[2018-10-09 11:36:43.093954] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on failed, (Permission denied)
[2018-10-09 11:36:43.094242] I [MSGID: 104024] [glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from remote-host: localhost
[2018-10-09 11:36:46.098039] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on failed, (Permission denied)
[2018-10-09 11:36:46.098160] I [MSGID: 104025] [glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile servers [Transport endpoint is not connected]
[2018-10-09 11:36:46.099301] I [MSGID: 101191] [event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with index 1
[2018-10-09 11:36:46.098158] I [MSGID: 104024] [glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from remote-host: localhost
[2018-10-09 11:36:46.099661] I [timer.c:89:gf_timer_call_cancel] (-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938] -->/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x33) [0x7f5d7ab08903] -->/lib64/libglusterfs.so.0(gf_timer_call_cancel+0x179) [0x7f5d7ab137f9] ) 0-timer: ctx cleanup started
[2018-10-09 11:37:00.456669] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction
[2018-10-09 11:37:00.466135] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on failed, (Permission denied)
[2018-10-09 11:37:00.466323] I [MSGID: 104024] [glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from remote-host: localhost
[2018-10-09 11:37:03.470127] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on failed, (Permission denied)
[2018-10-09 11:37:03.470275] I [MSGID: 104025] [glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile servers [Transport endpoint is not connected]
[2018-10-09 11:37:03.471773] I [MSGID: 101191] [event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with index 1
[2018-10-09 11:37:03.470274] I [MSGID: 104024] [glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from remote-host: localhost
[2018-10-09 11:37:03.472038] I [timer.c:89:gf_timer_call_cancel] (-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938] -->/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x33) [0x7f5d7ab08903] -->/lib64/libglusterfs.so.0(gf_timer_call_cancel+0x179) [0x7f5d7ab137f9] ) 0-timer: ctx cleanup started
[2018-10-09 12:19:48.258100] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction
[2018-10-09 12:19:48.267722] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on failed, (Permission denied)
[2018-10-09 12:19:48.268239] I [MSGID: 104024] [glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from remote-host: localhost
[2018-10-09 12:19:51.273134] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on failed, (Permission denied)
[2018-10-09 12:19:51.273266] I [MSGID: 104025] [glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile servers [Transport endpoint is not connected]
[2018-10-09 12:19:51.275239] I [MSGID: 101191] [event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with index 1
[2018-10-09 12:19:51.273265] I [MSGID: 104024] [glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from remote-host: localhost
[2018-10-09 12:19:51.275492] I [timer.c:89:gf_timer_call_cancel] (-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938] -->/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x33) [0x7f5d7ab08903] -->/lib64/libglusterfs.so.0(gf_timer_call_cancel+0x179) [0x7f5d7ab137f9] ) 0-timer: ctx cleanup started
[2018-10-09 12:20:56.711327] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction
[2018-10-09 12:20:56.720534] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on failed, (Permission denied)
[2018-10-09 12:20:56.720810] I [MSGID: 104024] [glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from remote-host: localhost
[2018-10-09 12:20:59.726063] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on failed, (Permission denied)
[2018-10-09 12:20:59.726187] I [MSGID: 104025] [glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile servers [Transport endpoint is not connected]
[2018-10-09 12:20:59.727301] I [MSGID: 101191] [event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with index 1
[2018-10-09 12:20:59.726186] I [MSGID: 104024] [glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from remote-host: localhost
[2018-10-09 12:20:59.727643] I [timer.c:89:gf_timer_call_cancel] (-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938] -->/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x33) [0x7f5d7ab08903] -->/lib64/libglusterfs.so.0(gf_timer_call_cancel+0x179) [0x7f5d7ab137f9] ) 0-timer: ctx cleanup started
Do you have any idea how can I solve this?
Thanks in advance!
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users

Christos Tsalidis

2018-10-09 15:11:02 UTC

Permalink

Hi,

I have moved a step further as now I can mount the volume on client
machine. It was selinux problem.

setsebool -P samba_load_libgfapi 1

However when I try to write a file on it,
I am receiving 'Permission denied'

[***@workstation smbdata]# df
Filesystem 1K-blocks Used Available Use%
Mounted on
/dev/mapper/centos-root 6486016 1191072 5294944 19% /
devtmpfs 495892 0 495892 0% /dev
tmpfs 507736 0 507736 0%
/dev/shm
tmpfs 507736 6836 500900 2% /run
tmpfs 507736 0 507736 0%
/sys/fs/cgroup
/dev/sda1 1038336 161940 876396 16% /boot
tmpfs 101548 0 101548 0%
/run/user/1000
//servera.lab.local/gluster-mastervol 2076672 66720 2009952 4%
/mnt/smbdata
[***@workstation smbdata]# ls
file00 file01 file02 file03 file04 file05 file06 file07 file08
file09 file10
[***@workstation smbdata]# touch file11
touch: cannot touch âfile11â: Permission denied

Any idea how can I solve this problem?

Thanks in advance!

Post by Diego Remolina
https://www.samba.org/samba/docs/current/man-html/vfs_glusterfs.8.html
Does adding: kernel share modes = no
to smb.conf and restarting samba helps?
FWIW, I have had many recent problems using the samba vfs plugins on
Centos 7.5 (latest) against a 3.10.x glusterfs server. When exporting
via samba and using vfs objects = glusterfs many different programs
have i/o errors specially when trying to save files.
Some specific files (Autodesk Revit files) present problem reading.
My current workaround for regular operation has been using a fuse
mount and sharing directly from it via samba. So commented out all the
vfs objects and gluster related configurations and exported the
locally fuse mounted directory.

Post by Christos Tsalidis
Hi all,
I am testing the samba client in glusterfs 3.12.14 version on CentOS

Linux release 7.5.1804 and getting a mount error(5): Input/output error.

Post by Christos Tsalidis
mount error(5): Input/output error
Refer to the mount.cifs(8) manual page (e.g. man mount.cifs)
//servera.lab.local/gluster-mastervol /mnt/smbdata cifs

user=smbuser,pass=redhat 0 0

Post by Christos Tsalidis
cifs-utils-6.2-10.el7.x86_64
cat /var/log/messages
Oct 9 13:50:33 workstation kernel: CIFS VFS: cifs_mount failed w/return

code = -5

Post by Christos Tsalidis
Oct 9 13:50:53 workstation kernel: CIFS VFS: cifs_mount failed w/return

code = -5

Post by Christos Tsalidis
Oct 9 13:51:49 workstation kernel: CIFS VFS: cifs_mount failed w/return

code = -5

Post by Christos Tsalidis
Oct 9 13:52:06 workstation kernel: CIFS VFS: cifs_mount failed w/return

code = -5

Post by Christos Tsalidis
Oct 9 14:01:02 workstation systemd: Created slice User Slice of root.
Oct 9 14:01:02 workstation systemd: Starting User Slice of root.
Oct 9 14:01:02 workstation systemd: Started Session 4 of user root.
Oct 9 14:01:02 workstation systemd: Starting Session 4 of user root.
Oct 9 14:01:02 workstation systemd: Removed slice User Slice of root.
Oct 9 14:01:02 workstation systemd: Stopping User Slice of root.
Oct 9 14:34:54 workstation kernel: CIFS VFS: cifs_mount failed w/return

code = -5

Post by Christos Tsalidis
Oct 9 14:36:02 workstation kernel: CIFS VFS: cifs_mount failed w/return

code = -5

Post by Christos Tsalidis
â smb.service - Samba SMB Daemon
Loaded: loaded (/usr/lib/systemd/system/smb.service; enabled; vendor

preset: disabled)

Post by Christos Tsalidis
Active: active (running) since Tue 2018-10-09 13:28:48 CEST; 53min ago
Main PID: 18707 (smbd)
Status: "smbd: ready to serve connections..."
CGroup: /system.slice/smb.service
ââ18707 /usr/sbin/smbd --foreground --no-process-group
ââ18709 /usr/sbin/smbd --foreground --no-process-group
ââ18710 /usr/sbin/smbd --foreground --no-process-group
ââ18711 /usr/sbin/smbd --foreground --no-process-group
Oct 09 13:35:49 servera.lab.local smbd[18986]: [2018/10/09

13:35:49.774640, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)

Post by Christos Tsalidis
Oct 09 13:35:49 servera.lab.local smbd[18986]: mastervol: Failed to

initialize volume (Transport endpoint is not connected)

Post by Christos Tsalidis
Oct 09 13:36:46 servera.lab.local smbd[18997]: [2018/10/09

13:36:46.098201, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)

Post by Christos Tsalidis
Oct 09 13:36:46 servera.lab.local smbd[18997]: mastervol: Failed to

initialize volume (Transport endpoint is not connected)

Post by Christos Tsalidis
Oct 09 13:37:03 servera.lab.local smbd[19036]: [2018/10/09

13:37:03.470317, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)

Post by Christos Tsalidis
Oct 09 13:37:03 servera.lab.local smbd[19036]: mastervol: Failed to

initialize volume (Transport endpoint is not connected)

Post by Christos Tsalidis
Oct 09 14:19:51 servera.lab.local smbd[19075]: [2018/10/09

14:19:51.273307, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)

Post by Christos Tsalidis
Oct 09 14:19:51 servera.lab.local smbd[19075]: mastervol: Failed to

initialize volume (Transport endpoint is not connected)

Post by Christos Tsalidis
Oct 09 14:20:59 servera.lab.local smbd[19085]: [2018/10/09

14:20:59.726227, 0] ../source3/modules/vfs_glusterfs.c:345(vfs...nnect)

Post by Christos Tsalidis
Oct 09 14:20:59 servera.lab.local smbd[19085]: mastervol: Failed to

initialize volume (Transport endpoint is not connected)

Pid
------------------------------------------------------------------------------

Post by Christos Tsalidis
Brick servera:/bricks/brick-a1/brick 49153 0 Y

18904

Post by Christos Tsalidis
Brick serverb:/bricks/brick-b1/brick 49153 0 Y

9654

Post by Christos Tsalidis
NFS Server on localhost 2049 0 Y

19024

Post by Christos Tsalidis
NFS Server on serverb.lab.local 2049 0 Y

9675

Post by Christos Tsalidis
Task Status of Volume mastervol

------------------------------------------------------------------------------

Post by Christos Tsalidis
There are no active volume tasks
ssh dhcpv6-client glusterfs nfs rpc-bind samba
smbuser:x:1001:1001::/home/smbuser:/sbin/nologin
# See smb.conf.example for a more detailed config file or
# read the smb.conf manpage.
# Run 'testparm' to verify the config is correct after
# you modified it.
[global]
workgroup = SAMBA
security = user
passdb backend = tdbsam
printing = cups
printcap name = cups
load printers = yes
cups options = raw
[homes]
comment = Home Directories
valid users = %S, %D%w%S
browseable = No
read only = No
inherit acls = Yes
[printers]
comment = All Printers
path = /var/tmp
printable = Yes
create mask = 0600
browseable = No
[print$]
comment = Printer Drivers
path = /var/lib/samba/drivers
create mask = 0664
directory mask = 0775
[gluster-mastervol]
comment = For samba share of volume mastervol
vfs objects = glusterfs
glusterfs:volume = mastervol
glusterfs:logfile = /var/log/samba/glusterfs-mastervol.%M.log
glusterfs:loglevel = 7
path = /
read only = no
guest ok = yes
[2018-10-09 11:35:25.955750] W [MSGID: 101002]

[options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is
deprecated, preferred is 'transport.address-family', continuing with
correction
connection attempt on failed, (Permission denied)

Post by Christos Tsalidis
[2018-10-09 11:35:25.966861] I [MSGID: 104024]

[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
connection attempt on failed, (Permission denied)

Post by Christos Tsalidis
[2018-10-09 11:35:29.969551] I [MSGID: 104025]

[glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile
servers [Transport endpoint is not connected]

Post by Christos Tsalidis
[2018-10-09 11:35:29.971484] I [MSGID: 101191]

[event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with
index 1

Post by Christos Tsalidis
[2018-10-09 11:35:29.969550] I [MSGID: 104024]

[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 11:35:29.971734] I [timer.c:89:gf_timer_call_cancel]

(-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938]
-->/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x33)
[0x7f5d7ab08903] -->/lib64/libglusterfs.so.0(gf_timer_call_cancel+0x179)
[0x7f5d7ab137f9] ) 0-timer: ctx cleanup started

Post by Christos Tsalidis
[2018-10-09 11:35:46.758283] W [MSGID: 101002]

[options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is
deprecated, preferred is 'transport.address-family', continuing with
correction
connection attempt on failed, (Permission denied)

Post by Christos Tsalidis
[2018-10-09 11:35:46.769146] I [MSGID: 104024]

[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
connection attempt on failed, (Permission denied)

Post by Christos Tsalidis
[2018-10-09 11:35:49.774597] I [MSGID: 104025]

[glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile
servers [Transport endpoint is not connected]

Post by Christos Tsalidis
[2018-10-09 11:35:49.776114] I [MSGID: 101191]

[event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with
index 1

Post by Christos Tsalidis
[2018-10-09 11:35:49.774595] I [MSGID: 104024]

[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 11:35:49.776381] I [timer.c:89:gf_timer_call_cancel]

Post by Christos Tsalidis
[2018-10-09 11:36:43.084797] W [MSGID: 101002]

[options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is
deprecated, preferred is 'transport.address-family', continuing with
correction
connection attempt on failed, (Permission denied)

Post by Christos Tsalidis
[2018-10-09 11:36:43.094242] I [MSGID: 104024]

[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
connection attempt on failed, (Permission denied)

Post by Christos Tsalidis
[2018-10-09 11:36:46.098160] I [MSGID: 104025]

[glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile
servers [Transport endpoint is not connected]

Post by Christos Tsalidis
[2018-10-09 11:36:46.099301] I [MSGID: 101191]

[event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with
index 1

Post by Christos Tsalidis
[2018-10-09 11:36:46.098158] I [MSGID: 104024]

[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 11:36:46.099661] I [timer.c:89:gf_timer_call_cancel]

Post by Christos Tsalidis
[2018-10-09 11:37:00.456669] W [MSGID: 101002]

[options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is
deprecated, preferred is 'transport.address-family', continuing with
correction
connection attempt on failed, (Permission denied)

Post by Christos Tsalidis
[2018-10-09 11:37:00.466323] I [MSGID: 104024]

[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
connection attempt on failed, (Permission denied)

Post by Christos Tsalidis
[2018-10-09 11:37:03.470275] I [MSGID: 104025]

[glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile
servers [Transport endpoint is not connected]

Post by Christos Tsalidis
[2018-10-09 11:37:03.471773] I [MSGID: 101191]

[event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with
index 1

Post by Christos Tsalidis
[2018-10-09 11:37:03.470274] I [MSGID: 104024]

[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 11:37:03.472038] I [timer.c:89:gf_timer_call_cancel]

Post by Christos Tsalidis
[2018-10-09 12:19:48.258100] W [MSGID: 101002]

[options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is
deprecated, preferred is 'transport.address-family', continuing with
correction
connection attempt on failed, (Permission denied)

Post by Christos Tsalidis
[2018-10-09 12:19:48.268239] I [MSGID: 104024]

[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
connection attempt on failed, (Permission denied)

Post by Christos Tsalidis
[2018-10-09 12:19:51.273266] I [MSGID: 104025]

[glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile
servers [Transport endpoint is not connected]

Post by Christos Tsalidis
[2018-10-09 12:19:51.275239] I [MSGID: 101191]

[event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with
index 1

Post by Christos Tsalidis
[2018-10-09 12:19:51.273265] I [MSGID: 104024]

[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 12:19:51.275492] I [timer.c:89:gf_timer_call_cancel]

Post by Christos Tsalidis
[2018-10-09 12:20:56.711327] W [MSGID: 101002]

[options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is
deprecated, preferred is 'transport.address-family', continuing with
correction
connection attempt on failed, (Permission denied)

Post by Christos Tsalidis
[2018-10-09 12:20:56.720810] I [MSGID: 104024]

[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost
connection attempt on failed, (Permission denied)

Post by Christos Tsalidis
[2018-10-09 12:20:59.726187] I [MSGID: 104025]

[glfs-mgmt.c:828:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all volfile
servers [Transport endpoint is not connected]

Post by Christos Tsalidis
[2018-10-09 12:20:59.727301] I [MSGID: 101191]

[event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Exited thread with
index 1

Post by Christos Tsalidis
[2018-10-09 12:20:59.726186] I [MSGID: 104024]

[glfs-mgmt.c:811:mgmt_rpc_notify] 0-glfs-mgmt: disconnected from
remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 12:20:59.727643] I [timer.c:89:gf_timer_call_cancel]

Post by Christos Tsalidis
Do you have any idea how can I solve this?
Thanks in advance!
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users

_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users

Anoop C S

2018-11-22 05:10:16 UTC

Permalink

Hi,
I have moved a step further as now I can mount the volume on client machine. It was selinux
problem.
setsebool -P samba_load_libgfapi 1
However when I try to write a file on it,
I am receiving 'Permission denied'
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/mapper/centos-root 6486016 1191072 5294944 19% /
devtmpfs 495892 0 495892 0% /dev
tmpfs 507736 0 507736 0% /dev/shm
tmpfs 507736 6836 500900 2% /run
tmpfs 507736 0 507736 0% /sys/fs/cgroup
/dev/sda1 1038336 161940 876396 16% /boot
tmpfs 101548 0 101548 0% /run/user/1000
//servera.lab.local/gluster-mastervol 2076672 66720 2009952 4% /mnt/smbdata
file00 file01 file02 file03 file04 file05 file06 file07 file08 file09 file10
touch: cannot touch ‘file11’: Permission denied
Any idea how can I solve this problem?

Is this still an issue for you?

Thanks in advance!

Post by Diego Remolina
Per: https://www.samba.org/samba/docs/current/man-html/vfs_glusterfs.8.html
Does adding: kernel share modes = no
to smb.conf and restarting samba helps?
FWIW, I have had many recent problems using the samba vfs plugins on
Centos 7.5 (latest) against a 3.10.x glusterfs server. When exporting
via samba and using vfs objects = glusterfs many different programs
have i/o errors specially when trying to save files.
Some specific files (Autodesk Revit files) present problem reading.
My current workaround for regular operation has been using a fuse
mount and sharing directly from it via samba. So commented out all the
vfs objects and gluster related configurations and exported the
locally fuse mounted directory.

Post by Christos Tsalidis
Hi all,
I am testing the samba client in glusterfs 3.12.14 version on CentOS Linux release 7.5.1804

and getting a mount error(5): Input/output error.

Post by Christos Tsalidis
mount error(5): Input/output error
Refer to the mount.cifs(8) manual page (e.g. man mount.cifs)
//servera.lab.local/gluster-mastervol /mnt/smbdata cifs user=smbuser,pass=redhat 0 0
cifs-utils-6.2-10.el7.x86_64
cat /var/log/messages
Oct 9 13:50:33 workstation kernel: CIFS VFS: cifs_mount failed w/return code = -5
Oct 9 13:50:53 workstation kernel: CIFS VFS: cifs_mount failed w/return code = -5
Oct 9 13:51:49 workstation kernel: CIFS VFS: cifs_mount failed w/return code = -5
Oct 9 13:52:06 workstation kernel: CIFS VFS: cifs_mount failed w/return code = -5
Oct 9 14:01:02 workstation systemd: Created slice User Slice of root.
Oct 9 14:01:02 workstation systemd: Starting User Slice of root.
Oct 9 14:01:02 workstation systemd: Started Session 4 of user root.
Oct 9 14:01:02 workstation systemd: Starting Session 4 of user root.
Oct 9 14:01:02 workstation systemd: Removed slice User Slice of root.
Oct 9 14:01:02 workstation systemd: Stopping User Slice of root.
Oct 9 14:34:54 workstation kernel: CIFS VFS: cifs_mount failed w/return code = -5
Oct 9 14:36:02 workstation kernel: CIFS VFS: cifs_mount failed w/return code = -5
● smb.service - Samba SMB Daemon
Loaded: loaded (/usr/lib/systemd/system/smb.service; enabled; vendor preset: disabled)
Active: active (running) since Tue 2018-10-09 13:28:48 CEST; 53min ago
Main PID: 18707 (smbd)
Status: "smbd: ready to serve connections..."
CGroup: /system.slice/smb.service
├─18707 /usr/sbin/smbd --foreground --no-process-group
├─18709 /usr/sbin/smbd --foreground --no-process-group
├─18710 /usr/sbin/smbd --foreground --no-process-group
└─18711 /usr/sbin/smbd --foreground --no-process-group
Oct 09 13:35:49 servera.lab.local smbd[18986]: [2018/10/09 13:35:49.774640, 0]

../source3/modules/vfs_glusterfs.c:345(vfs...nnect)

Post by Christos Tsalidis
Oct 09 13:35:49 servera.lab.local smbd[18986]: mastervol: Failed to initialize volume

(Transport endpoint is not connected)

Post by Christos Tsalidis
Oct 09 13:36:46 servera.lab.local smbd[18997]: [2018/10/09 13:36:46.098201, 0]

../source3/modules/vfs_glusterfs.c:345(vfs...nnect)

Post by Christos Tsalidis
Oct 09 13:36:46 servera.lab.local smbd[18997]: mastervol: Failed to initialize volume

(Transport endpoint is not connected)

Post by Christos Tsalidis
Oct 09 13:37:03 servera.lab.local smbd[19036]: [2018/10/09 13:37:03.470317, 0]

../source3/modules/vfs_glusterfs.c:345(vfs...nnect)

Post by Christos Tsalidis
Oct 09 13:37:03 servera.lab.local smbd[19036]: mastervol: Failed to initialize volume

(Transport endpoint is not connected)

Post by Christos Tsalidis
Oct 09 14:19:51 servera.lab.local smbd[19075]: [2018/10/09 14:19:51.273307, 0]

../source3/modules/vfs_glusterfs.c:345(vfs...nnect)

Post by Christos Tsalidis
Oct 09 14:19:51 servera.lab.local smbd[19075]: mastervol: Failed to initialize volume

(Transport endpoint is not connected)

Post by Christos Tsalidis
Oct 09 14:20:59 servera.lab.local smbd[19085]: [2018/10/09 14:20:59.726227, 0]

../source3/modules/vfs_glusterfs.c:345(vfs...nnect)

Post by Christos Tsalidis
Oct 09 14:20:59 servera.lab.local smbd[19085]: mastervol: Failed to initialize volume

(Transport endpoint is not connected)

Post by Christos Tsalidis
Hint: Some lines were ellipsized, use -l to show in full.
Volume Name: mastervol
Type: Distribute
Volume ID: f6bfe62f-068d-4ade-8d47-ee2e61418804
Status: Started
Snapshot Count: 0
Number of Bricks: 2
Transport-type: tcp
Brick1: servera:/bricks/brick-a1/brick
Brick2: serverb:/bricks/brick-b1/brick
storage.batch-fsync-delay-usec: 0
server.allow-insecure: on
performance.stat-prefetch: off
transport.address-family: inet
nfs.disable: off
Status of volume: mastervol
Gluster process TCP Port RDMA Port Online Pid
------------------------------------------------------------------------------
Brick servera:/bricks/brick-a1/brick 49153 0 Y 18904
Brick serverb:/bricks/brick-b1/brick 49153 0 Y 9654
NFS Server on localhost 2049 0 Y 19024
NFS Server on serverb.lab.local 2049 0 Y 9675
Task Status of Volume mastervol
------------------------------------------------------------------------------
There are no active volume tasks
ssh dhcpv6-client glusterfs nfs rpc-bind samba
smbuser:x:1001:1001::/home/smbuser:/sbin/nologin
# See smb.conf.example for a more detailed config file or
# read the smb.conf manpage.
# Run 'testparm' to verify the config is correct after
# you modified it.
[global]
workgroup = SAMBA
security = user
passdb backend = tdbsam
printing = cups
printcap name = cups
load printers = yes
cups options = raw
[homes]
comment = Home Directories
valid users = %S, %D%w%S
browseable = No
read only = No
inherit acls = Yes
[printers]
comment = All Printers
path = /var/tmp
printable = Yes
create mask = 0600
browseable = No
[print$]
comment = Printer Drivers
path = /var/lib/samba/drivers
create mask = 0664
directory mask = 0775
[gluster-mastervol]
comment = For samba share of volume mastervol
vfs objects = glusterfs
glusterfs:volume = mastervol
glusterfs:logfile = /var/log/samba/glusterfs-mastervol.%M.log
glusterfs:loglevel = 7
path = /
read only = no
guest ok = yes
[2018-10-09 11:35:25.955750] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-gfapi: option

'address-family' is deprecated, preferred is 'transport.address-family', continuing with
correction

Post by Christos Tsalidis
[2018-10-09 11:35:25.966487] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on

failed, (Permission denied)
disconnected from remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 11:35:29.969343] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on

failed, (Permission denied)
Exhausted all volfile servers [Transport endpoint is not connected]

Post by Christos Tsalidis
[2018-10-09 11:35:29.971484] I [MSGID: 101191] [event-epoll.c:644:event_dispatch_epoll_worker]

0-epoll: Exited thread with index 1
disconnected from remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 11:35:29.971734] I [timer.c:89:gf_timer_call_cancel] (

-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938] --

Post by Christos Tsalidis
/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x33) [0x7f5d7ab08903] --
/lib64/libglusterfs.so.0(gf_timer_call_cancel+0x179) [0x7f5d7ab137f9] ) 0-timer: ctx cleanup

started

Post by Christos Tsalidis
[2018-10-09 11:35:46.758283] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-gfapi: option

'address-family' is deprecated, preferred is 'transport.address-family', continuing with
correction

Post by Christos Tsalidis
[2018-10-09 11:35:46.768809] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on

failed, (Permission denied)
disconnected from remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 11:35:49.774441] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on

failed, (Permission denied)
Exhausted all volfile servers [Transport endpoint is not connected]

Post by Christos Tsalidis
[2018-10-09 11:35:49.776114] I [MSGID: 101191] [event-epoll.c:644:event_dispatch_epoll_worker]

0-epoll: Exited thread with index 1
disconnected from remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 11:35:49.776381] I [timer.c:89:gf_timer_call_cancel] (

-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938] --

started

Post by Christos Tsalidis
[2018-10-09 11:36:43.084797] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-gfapi: option

'address-family' is deprecated, preferred is 'transport.address-family', continuing with
correction

Post by Christos Tsalidis
[2018-10-09 11:36:43.093954] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on

failed, (Permission denied)
disconnected from remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 11:36:46.098039] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on

failed, (Permission denied)
Exhausted all volfile servers [Transport endpoint is not connected]

Post by Christos Tsalidis
[2018-10-09 11:36:46.099301] I [MSGID: 101191] [event-epoll.c:644:event_dispatch_epoll_worker]

0-epoll: Exited thread with index 1
disconnected from remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 11:36:46.099661] I [timer.c:89:gf_timer_call_cancel] (

-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938] --

started

Post by Christos Tsalidis
[2018-10-09 11:37:00.456669] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-gfapi: option

'address-family' is deprecated, preferred is 'transport.address-family', continuing with
correction

Post by Christos Tsalidis
[2018-10-09 11:37:00.466135] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on

failed, (Permission denied)
disconnected from remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 11:37:03.470127] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on

failed, (Permission denied)
Exhausted all volfile servers [Transport endpoint is not connected]

Post by Christos Tsalidis
[2018-10-09 11:37:03.471773] I [MSGID: 101191] [event-epoll.c:644:event_dispatch_epoll_worker]

0-epoll: Exited thread with index 1
disconnected from remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 11:37:03.472038] I [timer.c:89:gf_timer_call_cancel] (

-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938] --

started

Post by Christos Tsalidis
[2018-10-09 12:19:48.258100] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-gfapi: option

'address-family' is deprecated, preferred is 'transport.address-family', continuing with
correction

Post by Christos Tsalidis
[2018-10-09 12:19:48.267722] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on

failed, (Permission denied)
disconnected from remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 12:19:51.273134] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on

failed, (Permission denied)
Exhausted all volfile servers [Transport endpoint is not connected]

Post by Christos Tsalidis
[2018-10-09 12:19:51.275239] I [MSGID: 101191] [event-epoll.c:644:event_dispatch_epoll_worker]

0-epoll: Exited thread with index 1
disconnected from remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 12:19:51.275492] I [timer.c:89:gf_timer_call_cancel] (

-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938] --

started

Post by Christos Tsalidis
[2018-10-09 12:20:56.711327] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-gfapi: option

'address-family' is deprecated, preferred is 'transport.address-family', continuing with
correction

Post by Christos Tsalidis
[2018-10-09 12:20:56.720534] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on

failed, (Permission denied)
disconnected from remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 12:20:59.726063] E [socket.c:3295:socket_connect] 0-gfapi: connection attempt on

failed, (Permission denied)
Exhausted all volfile servers [Transport endpoint is not connected]

Post by Christos Tsalidis
[2018-10-09 12:20:59.727301] I [MSGID: 101191] [event-epoll.c:644:event_dispatch_epoll_worker]

0-epoll: Exited thread with index 1
disconnected from remote-host: localhost

Post by Christos Tsalidis
[2018-10-09 12:20:59.727643] I [timer.c:89:gf_timer_call_cancel] (

-->/lib64/libglusterfs.so.0(gf_log_fini+0x18) [0x7f5d7ab08938] --

started

_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users