libfuse.so: error adding symbols: File in wrong format

Ezka

Hi, as I'm facing the same issue for the arm64 docker, I've build it in qemu with your fix_fuse_dependancy_arm branch and it works for me.

julien-f

@maverick npm i replace yarn, not yarn build.

mavoff

@julien-f so i should issue yarn build after doing npm i gotcha. Give me a couple minutes will update you in an instant.

mavoff

after building when I open XO on the browser I only get an error saying

Cannot GET /

I'll have to redo from source. Give me a couple of days please I've been a bit overwhelmed these last days

julien-f

@maverick No hurries, we have a lot on our plates too.

mavoff

@julien-f thanks. in the meanwhile let me ask @Ezka when you rebuilt did you use npm i instead of yarn or just the plain old yard command?

Ezka

@maverick

I've use something like :

npm install && npm run build

and in doubt I've rebuild with:

npm install && yarn build

both work, no surprises here.

Note that the npm install step on arm64 takes ages in comparison to the x86_64 arch. It was already slow with yarn, but npm is a pain. I've try to build it on Github infra to release a multiarch docker but it reaches the max execution time

tamas

I am also affected by this error message and now, according to the suggestions posted here, I had been able to build the version. However, now when I want to start the xo-server, I get the following message:

# /usr/local/bin/node ./dist/cli.mjs
node:internal/modules/cjs/loader:985
  const err = new Error(message);
              ^

Error: Cannot find module 'strnum'
Require stack:
- /opt/xen-orchestra/packages/xo-server/node_modules/fast-xml-parser/src/xmlparser/OrderedObjParser.js
- /opt/xen-orchestra/packages/xo-server/node_modules/fast-xml-parser/src/xmlparser/XMLParser.js
- /opt/xen-orchestra/packages/xo-server/node_modules/fast-xml-parser/src/fxp.js
    at Function.Module._resolveFilename (node:internal/modules/cjs/loader:985:15)
    at Function.Module._load (node:internal/modules/cjs/loader:833:27)
    at Module.require (node:internal/modules/cjs/loader:1057:19)
    at require (node:internal/modules/cjs/helpers:103:18)
    at Object.<anonymous> (/opt/xen-orchestra/packages/xo-server/node_modules/fast-xml-parser/src/xmlparser/OrderedObjParser.js:7:18)
    at Module._compile (node:internal/modules/cjs/loader:1155:14)
    at Object.Module._extensions..js (node:internal/modules/cjs/loader:1209:10)
    at Module.load (node:internal/modules/cjs/loader:1033:32)
    at Function.Module._load (node:internal/modules/cjs/loader:868:12)
    at Module.require (node:internal/modules/cjs/loader:1057:19)
    at require (node:internal/modules/cjs/helpers:103:18)
    at Object.<anonymous> (/opt/xen-orchestra/packages/xo-server/node_modules/fast-xml-parser/src/xmlparser/XMLParser.js:2:26)
    at Module._compile (node:internal/modules/cjs/loader:1155:14)
    at Object.Module._extensions..js (node:internal/modules/cjs/loader:1209:10)
    at Module.load (node:internal/modules/cjs/loader:1033:32)
    at Function.Module._load (node:internal/modules/cjs/loader:868:12) {
  code: 'MODULE_NOT_FOUND',
  requireStack: [
    '/opt/xen-orchestra/packages/xo-server/node_modules/fast-xml-parser/src/xmlparser/OrderedObjParser.js',
    '/opt/xen-orchestra/packages/xo-server/node_modules/fast-xml-parser/src/xmlparser/XMLParser.js',
    '/opt/xen-orchestra/packages/xo-server/node_modules/fast-xml-parser/src/fxp.js'
  ]
}

What can I do here to get the interface working again?

TIA

florent

@tamas said in libfuse.so: error adding symbols: File in wrong format:

fast-xml-parser

fast-xml-parser is an older deps (last change is at least a few months old). Do you know which is the last working version on your system ?

tamas

@florent said in libfuse.so: error adding symbols: File in wrong format:

@tamas said in libfuse.so: error adding symbols: File in wrong format:

fast-xml-parser

fast-xml-parser is an older deps (last change is at least a few months old). Do you know which is the last working version on your system ?

Unglücklicherweise weiß ich das nicht. Die funktionierende Version hatte ich vor circa 3 Monaten installiert.

Mark C

@florent said in libfuse.so: error adding symbols: File in wrong format:

@maverick using system li b will add a tight dependency, it will be harder to make it work on exotic systems

I pushed a new patch on the same branch, can you tell me if it solves the problem ?

Hi @florent,

I know this is an old topic, but I was looking to build XO on ARM64 recently and I ran across the issue that the node fuse-native package doesn't support arm64 and appears to be abandoned, and your branch with making it an optional dependancy. Thanks!

However, digging a bit more, I found https://github.com/sagemathinc/fuse-native which looks to be a very recent derivation of the published fuse-native module that has been adjusted to use system libraries on the build host rather than binaries bundled into the module.

Reworking this fix to use this alternative might give working fuse support on ARM64.

What do you think? I guess in terms of the non-ARM64 builds, it is a risk/new dependancy to use the system's fuse libraries but maybe a better approach long term as the libfuse.so in fuse-friends is increasingly old and lacking in updates.

Mark

olivierlambert

Sounds like a good idea However, I don't think our current XOAs are shipped with fuse libs directly, so that might break for our XOA users

At least we can take a look to test it!

Mark C

@olivierlambert - thanks for getting back on this.

My limited testing so far was to substitute the alternate fuse-native module. ( There's probably a better way to do this but I didn't really want to fork the repo for some quick tests! )

Make a build folder, then git clone https://github.com/sagemathinc/fuse-native
Edit the sagemathinc package.json so that the name and version match the fuse-friends version (to avoid having to adjust any of the xen-orchestra files directly)
git clone https://github.com/vatesfr/xen-orchestra.git
copy the modified fuse-native folder into the xen-orchestra folder
Run 'yarn link' in xen-orchestra/fuse-native folder to tell yarn to use this local module instead of the fuse-friends version
Run 'yarn link fuse-native' in the xen-orchestra folder to have the xen-orchestra build use the local version
Run yarn and yarn build as per the build-from-source page

I got a version of xo-server built from current master, and it started up. I haven't done anything with it yet beyond the initial smoke-test.

Wrinkles - I needed to add pkg-config to the debian 12 build and host VM as sagemathinc's fuse-native module uses that to locate the system libfuse libraries. So if you're looking at the XOA side, then pkg-config would be a new build dependancy in addition to the host's libfuse libraries.

Sincerely,

Mark

xo-server 5.120.2 / xo-web 5.122.2 / commit 3baa378

olivierlambert

It's not a problem per se to add a new package in XOA, it's just that we can't do that for all existing/running XOAs for our existing customers. So we can't afford to break it. What we usually do, is to regen a new XOA from time to time (a fresh one is coming in September) on Debian 12.

I'll check to see if we can add a package for fuse, but this won't solve it for our existing users

florent

@Mark-C I can't test easily for now, but I think there may be an easier path after reviewing your solution

fuse-native use fuse-shared-library 1.0.2
from version 1.1 , fuse-shared-library should support ARM , maybe it is possible to bump it in the dependencies of fuse-native ?

This way , it should still work without libfuse on the system, but also build it on arm

Mark C

@florent said in libfuse.so: error adding symbols: File in wrong format:

@Mark-C I can't test easily for now, but I think there may be an easier path after reviewing your solution

fuse-native use fuse-shared-library 1.0.2
from version 1.1 , fuse-shared-library should support ARM , maybe it is possible to bump it in the dependencies of fuse-native ?

This way , it should still work without libfuse on the system, but also build it on arm

Hi @florent ,

I am building on aarch64 / ARM64 rather than just arm.

I did look at fuse-shared-library-linux-arm library - the embedded libfuse.so in that is a 32 bit version rather than 64 bit from what I could see:

root@xo-aarch64:/home/xo/xoi/xo-builds/xen-orchestra-202308250931/node_modules/fuse-shared-library-linux-arm/libfuse/lib# file libfuse.so
libfuse.so: ELF 32-bit LSB shared object, ARM, EABI5 version 1 (SYSV), dynamically linked, BuildID[sha1]=6ed4a4b321ab69af9aeef3db322ba67396f4d52b, stripped

That's in contrast to the system library:

/usr/lib/aarch64-linux-gnu/libfuse.so: ELF 64-bit LSB shared object, ARM aarch64, version 1 (SYSV), dynamically linked, BuildID[sha1]=29ce785f4418d869ead1b31501c4a82446de0cfe, stripped

@olivierlambert - I do appreciate the support issue for existing platforms and users. This is very much me looking at using a turing pi 2 as a low power setup in my home lab and I appreciate it is a niche case.

The more supportable fix would be to add ARM64 support into the fuse-friends version of fuse-native, but it seems that node's current policies don't allow adoption of orphaned/abandoned modules to avoid supply-chain attacks. [ https://docs.npmjs.com/policies/disputes - When not to use this process ].

mavoff

Looking for a long term fix. Thanks.

Mark C

Hi @maverick,

I've not done much with this since my 'bodge' to build an ARM64 version back in August.

The version I have running on a Raspberry Pi CM4 from back then does appear to be functioning as expected for everything I have tried. ( Basic start / stop / backup / restore / create / destroy for a small XCP-NG cluster running on x64. ). That satisfies my use case to have XO from the sources running on something that isn't the cluster it is managing.

I do understand the support issues @olivierlambert flagged up in August, and I don't have any good solutions to resolve those for existing deployments of XOA doing upgrades rather than fresh installs. That's something the real maintainers will have to consider around the (minor) benefit of building for ARM64 vs any related support overheads of existing XOA upgrade issues.

Sincerely,

Mark

mavoff

@Mark-C Hi there

I had this fuse fix for arm working for a long while.
Recently due to another issue I was pushed towards updating, only to get a broken XO and issue abandoned. Even when shown that I was on this branch specifically, fix_fuse_dependancy_arm.

Also tried your suggestion as a fix, but not quite working.

# yarn
yarn install v1.22.19
[1/5] Validating package.json...
[2/5] Resolving packages...
[3/5] Fetching packages...
[4/5] Linking dependencies...
warning "workspace-aggregator-7976f8d6-c4ac-4618-ae07-8b737c9d1cc1 > @xen-orchestra/fs > @aws-sdk/lib-storage@3.171.0" has unmet peer dependency "@aws-sdk/abort-controller@^3.0.0".
warning Workspaces can only be enabled in private projects.
[5/5] Building fresh packages...
[1/12] ⠐ husky
[6/12] ⠐ argon2
[3/12] ⠐ highlight.js
[4/12] ⠐ esbuild
warning Error running install script for optional dependency: "/opt/xen-orchestra/node_modules/fuse-native: Command failed.
Exit code: 1
Command: node-gyp-build
Arguments: 
Directory: /opt/xen-orchestra/node_modules/fuse-native
Output:
node:events:495
      throw er; // Unhandled 'error' event
      ^

Error: spawn node-gyp ENOENT
    at ChildProcess._handle.onexit (node:internal/child_process:284:19)
    at onErrorNT (node:internal/child_process:477:16)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
Emitted 'error' event on ChildProcess instance at:
    at ChildProcess._handle.onexit (node:internal/child_process:290:12)
    at onErrorNT (node:internal/child_process:477:16)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
  errno: -2,
  code: 'ENOENT',
  syscall: 'spawn node-gyp',
  path: 'node-gyp',
  spawnargs: [ 'rebuild' ]
[10/12] ⠠ core-js
[6/12] ⠠ argon2
[8/12] ⠠ vuepress
[7/12] ⠠ leveldown
error /opt/xen-orchestra/node_modules/leveldown: Command failed.
Exit code: 1
Command: node-gyp-build
Arguments: 
Directory: /opt/xen-orchestra/node_modules/leveldown
Output:
node:events:495
      throw er; // Unhandled 'error' event
      ^

Error: spawn node-gyp ENOENT
    at ChildProcess._handle.onexit (node:internal/child_process:284:19)
    at onErrorNT (node:internal/child_process:477:16)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
Emitted 'error' event on ChildProcess instance at:
    at ChildProcess._handle.onexit (node:internal/child_process:290:12)
    at onErrorNT (node:internal/child_process:477:16)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
  errno: -2,
  code: 'ENOENT',
  syscall: 'spawn node-gyp',
  path: 'node-gyp',
  spawnargs: [ 'rebuild' ]

Thank you for your reply either way. Cheers

Mark C

@maverick Hi Maverick,

I just tried a test build prep and it seems to work for me. I created a new user, xo_test and swapped to it, then:


xo_test@xo2:~$ mkdir build
xo_test@xo2:~$ cd build/
xo_test@xo2:~/build$ git clone https://github.com/sagemathinc/fuse-native
Cloning into 'fuse-native'...
remote: Enumerating objects: 409, done.
remote: Counting objects: 100% (409/409), done.
remote: Compressing objects: 100% (160/160), done.
remote: Total 409 (delta 259), reused 396 (delta 246), pack-reused 0
Receiving objects: 100% (409/409), 150.36 KiB | 2.64 MiB/s, done.
Resolving deltas: 100% (259/259), done.

xo_test@xo2:~/build$ git clone https://github.com/vatesfr/xen-orchestra.git
Cloning into 'xen-orchestra'...
remote: Enumerating objects: 119983, done.
remote: Counting objects: 100% (3095/3095), done.
remote: Compressing objects: 100% (1400/1400), done.
remote: Total 119983 (delta 2143), reused 2278 (delta 1654), pack-reused 116888
Receiving objects: 100% (119983/119983), 64.38 MiB | 9.78 MiB/s, done.
Resolving deltas: 100% (86309/86309), done.

xo_test@xo2:~/build$ cp -a fuse-native fuse-native.orig
xo_test@xo2:~/build/fuse-native$ nano -w fuse-native/package.json 

xo_test@xo2:~/build$ diff -u fuse-native.orig fuse-native
Common subdirectories: fuse-native.orig/.git and fuse-native/.git
diff -u fuse-native.orig/package.json fuse-native/package.json
--- fuse-native.orig/package.json	2023-10-23 14:25:18.067638984 +0100
+++ fuse-native/package.json	2023-10-23 14:29:19.703990676 +0100
@@ -1,6 +1,6 @@
 {
-  "name": "@cocalc/fuse-native",
-  "version": "2.4.0",
+  "name": "fuse-native",
+  "version": "2.2.6",
   "description": "Node.js bindings for the FUSE api (Filesystem in Userspace)",
   "main": "index.js",
   "bin": {
@@ -28,7 +28,7 @@
   },
   "repository": {
     "type": "git",
-    "url": "https://github.com/sagemathinc/fuse-native.git"
+    "url": "https://github.com/fuse-friends/fuse-native.git"
   },
   "author": {
     "name": "William Stein (SageMath, Inc.)",
@@ -44,7 +44,7 @@
   "author": " ()",
   "license": "MIT",
   "bugs": {
-    "url": "https://github.com/sagemathinc/fuse-native/issues"
+    "url": "https://github.com/fuse-friends/fuse-native/issues"
   },
-  "homepage": "https://github.com/sagemathinc/fuse-native"
+  "homepage": "https://github.com/fuse-friends/fuse-native"
 }
Common subdirectories: fuse-native.orig/test and fuse-native/test

xo_test@xo2:~/build$ cp -a fuse-native xen-orchestra
xo_test@xo2:~/build$ cd xen-orchestra/
xo_test@xo2:~/build/xen-orchestra$ cd fuse-native/
xo_test@xo2:~/build/xen-orchestra/fuse-native$ yarn link
yarn link v1.22.19
success Registered "fuse-native".
info You can now run `yarn link "fuse-native"` in the projects where you want to use this package and it will be used instead.
Done in 0.15s.

xo_test@xo2:~/build/xen-orchestra/fuse-native$ cd ..
xo_test@xo2:~/build/xen-orchestra$ yarn link fuse-native
yarn link v1.22.19
success Using linked package for "fuse-native".
Done in 0.13s.

xo_test@xo2:~/build/xen-orchestra$ yarn
yarn install v1.22.19
[1/5] Validating package.json...
[2/5] Resolving packages...
[3/5] Fetching packages...
warning url-loader@1.1.2: Invalid bin field for "url-loader".
[4/5] Linking dependencies...
warning "workspace-aggregator-6dab12fa-fabf-4759-8627-2058ff251bdf > @vates/node-vsphere-soap > soap@1.0.0" has incorrect peer dependency "axios@^0.27.2".
warning Workspaces can only be enabled in private projects.
[5/5] Building fresh packages...
$ husky install
husky - Git hooks installed
Done in 425.65s.

I haven't kicked off the yarn build, but it was the yarn stage that failed for you.

Does the above help? [ As I said back in August, manually editing the package.json for sagemathinc's fuse-native to match the fuse-friends one that is called out in the xen-orchestra git tree is a completely horrible hack, but it does seem to work for me. ]

xo_test@xo2:~/build$ cat /etc/debian_version 
12.2

Cheers,

Mark

EDIT 24/Oct/2023: The build needs node-gyp and node-gyp-build packages installing with npm, and the fuse libraries and devel packages and pkg-config for the operating system, along with the pre-reqs noted in the XO from the Sources build instructions in the wiki. The build host needs a decent amount of RAM - it built for me in 3GB but failed with 1GB. Once built, it runs fine for me with 1GB.