XO Remote mount.nfs: access denied by server while mounting

Danp

@aninmanchester said in XO Remote mount.nfs: access denied by server while mounting:

"stderr": "mount.nfs: access denied by server while mounting 192.168.11.60:/Backups",

Would appear to be a rights issue to me.

daninmanchester

@anp I thought as much and have been playing with the settings without success. I don't know a lot about NFS.

I'm using the following options at present, but have tried with various users and groups, etc.

rw,all_squash,insecure,async,no_subtree_check,anongid=100,crossmnt

tjkreidl

@aninmanchester Run the "showmount" comand against your NFS server to see if you have access permissions. https://www.thegeekdiary.com/showmount-command-examples-in-linux/

daninmanchester

@jkreidl verified they can be seen :

Export list for 192.168.11.60:
/export/Backups 192.168.11.0/24
/export/Everyone 192.168.11.0/24
/export 192.168.11.0/24

tjkreidl

@aninmanchester What does showmount list for the server exports? Is the local 192.168.X.X subnet properly exported from the NFS server? Check the /etc/exports files on the NFS server and make sure that directory is listed. BTW, do you have any sort of multipathing implemented?

daninmanchester

@jkreidl

I don't touch things manually, it's done through OMV. This is the exports file. I don't have any multipathing as far as I know. It's not something I've set up.

# This file is auto-generated by openmediavault (https://www.openmediavault.org)
# WARNING: Do not edit this file, your changes will get lost.

# /etc/exports: the access control list for filesystems which may be exported
#               to NFS clients.  See exports(5).
/export/Everyone 192.168.11.0/24(fsid=94a977de-432c-4653-9870-a1cd0a83110d,ro,subtree_check,insecure,crossmnt)
/export/Backups 192.168.11.0/24(fsid=bb941285-c5d8-492d-9b49-43a2dc30557c,rw,all_squash,insecure,async,no_subtree_check,anongid=100,crossmnt)

# NFSv4 - pseudo filesystem root
/export 192.168.11.0/24(ro,fsid=0,root_squash,no_subtree_check,hide)
/export 192.168.11.70(ro,fsid=0,root_squash,no_subtree_check,hide)

tjkreidl

@aninmanchester Hmmm...maybe an NFS V3 vs. V4 support issue? Could you provide the full output of "showmount -e 192.168.11.60" ?

daninmanchester

@jkreidl what version should I be using or can I force XO to use a particular version?

It doesn't output any more than I shared last time :

bash-5.1# showmount -e 192.168.11.60
Export list for 192.168.11.60:
/export/Backups 192.168.11.0/24
/export/Everyone 192.168.11.0/24
/export 192.168.11.0/24
bash-5.1#

It just occurred to me, I'm running XO in a docker not direct on the host. Do I need some network config to enable NFS?

Danp

@aninmanchester Have you read this info?

HeMaN

@anp said in XO Remote mount.nfs: access denied by server while mounting:

@aninmanchester said in XO Remote mount.nfs: access denied by server while mounting:

"stderr": "mount.nfs: access denied by server while mounting 192.168.11.60:/Backups",

Would appear to be a rights issue to me.

@jkreidl verified they can be seen :

Export list for 192.168.11.60:
/export/Backups 192.168.11.0/24
/export/Everyone 192.168.11.0/24
/export 192.168.11.0/24

do you need to add "/export" (/export/Backups ) to be able to find the right path?

tjkreidl

@eMaN Yes, if I recall correctly, in the /etc/exports file. the full path should be specified and then "exportfs -a" should be issued to refresh the export list.
I just noticed your error message doesn't include the /export directory in front:
mount.nfs: access denied by server while mounting 192.168.11.60:/Backups

daninmanchester

@anp no, I hadn't seen that. but I think I have now done this without any change to my issue. One thing that wasn't 100% clear is where sudoers should be on docker.

/etc/sudoers?

daninmanchester

@jkreidl I have tried various flavors.

daninmanchester

Well .... I'm totally baffled.
I've tried reapplying permissions.
forcing the server UID/GID
forcing the client UID/GID.
NOACLs
Squashing.

One thing I can say, is that it is working on my host so it must be something about my XO setup trying to talk to it. which may well still be permissions.

daninmanchester

okay, so I further narrowed it down. on the host machine I can mount. it is only within the docker container it is the issue. either at the command line or at XO. This leads me to believe this is a docker related problem not XO.

Sorry to have taken up your time, but thanks very much for your help!
At least i have a clear direction to google now.

mjtbrady

@aninmanchester

What is the IP address of the host that is running XO?

The docker container will need the SYS_ADMIN capability to do NFS mounts.

tjkreidl

@aninmanchester I would think Docker is involved, as well. I was going to suggest to create a "standard" test VM ans see if you can connect storage to it. If so, that would put the blame on something specific to the VM that has that Docker container.

tjkreidl

@jtbrady That seems right, because the Docker instanceis independent and internal to the VM that otherwise is part of the XCP-ng networking structure and wouldn't have the necessary access permissions on it's own.

Danp

Could this be due to a missing package (nfs-common)?

daninmanchester

I setup another VM as someone suggested and the NFS share mounted and worked. So there is something I am not understanding about docker permissions / requirements.

In the end, following a permissions reset and forcing the NFS share to squash and use my user/group ID I think I have progress. I can see it is writing to the NFS share.

Then I got : EEXIST: file already exists, open '/run/xo-server/mounts/6299d107-2aa2-41bf-bfd7-2f487ff5422f/xo-vm-backups/801e2b10-5c7d-b7af-ad5e-fbcc83e47d5b/.20220930T221548Z.xva'

A quick google led me to this being related to nfs 3. I switched to NFS 4 then I got path not found.

Not sure why, but I tried removing "export" from the path and it worked.

It does appear now to be running a backup job .... fingers crossed.

What a mine field!

Thanks for all the pointers.