Umbrel System fail

Hi sorry for another system service failed but i’ve read the debug and can’t pinpoint the pb. Before Umbrel crashed completly it gave me an sd card failure notice so i changed it but still can access Umbrel.
My setup is a raspberry pi 4b 8GB RAM 2TB SSD 32GB micro SD official power cable.
Here is the debug:

C:\Users\asari>ssh -t umbrel@umbrel.local “~/umbrel/scripts/debug”
umbrel@umbrel.local’s password:

= Umbrel debug info =

Umbrel version

0.5.4

Flashed OS version

v0.5.4-patch-1

Raspberry Pi Model

Revision : d03115
Serial : 100000002e3664d9
Model : Raspberry Pi 4 Model B Rev 1.5

Firmware

May 9 2023 12:16:34
Copyright (c) 2012 Broadcom
version 30aa0d70ab280427ba04ebc718c81d4350b9d394 (clean) (release) (start)

Temperature

temp=39.4’C

Throttling

throttled=0x0

Memory usage

          total        used        free      shared  buff/cache   available

Mem: 7.8G 103M 7.5G 8.0M 231M 7.6G
Swap: 4.1G 0B 4.1G

total: 1.3%
system: 1.3%

Memory monitor logs

2024-01-13 12:04:13 Memory monitor running!
2024-01-15 15:07:52 Memory monitor running!
2024-01-22 06:54:32 Memory monitor running!
2024-01-22 13:15:26 Memory monitor running!
2024-01-24 06:56:46 Memory monitor running!
2024-01-24 07:33:52 Memory monitor running!

Filesystem information

Filesystem Size Used Avail Use% Mounted on
/dev/root 30G 3.5G 25G 13% /
/dev/sda1 3.6T 714G 2.8T 21% /home/umbrel/umbrel

Startup service logs

– Logs begin at Thu 2024-01-25 22:22:14 UTC, end at Thu 2024-01-25 22:23:32 UTC. –
Jan 25 22:23:06 umbrel systemd[1]: Starting Umbrel Startup Service…
Jan 25 22:23:06 umbrel umbrel startup[1095]: parse error: Unfinished string at EOF at line 1, column 1044
Jan 25 22:23:06 umbrel systemd[1]: umbrel-startup.service: Control process exited, code=exited, status=4/NOPERMISSION
Jan 25 22:23:06 umbrel systemd[1]: umbrel-startup.service: Failed with result ‘exit-code’.
Jan 25 22:23:06 umbrel systemd[1]: Failed to start Umbrel Startup Service.
Jan 25 22:23:17 umbrel systemd[1]: umbrel-startup.service: Service RestartSec=10s expired, scheduling restart.
Jan 25 22:23:17 umbrel systemd[1]: umbrel-startup.service: Scheduled restart job, restart counter is at 1.
Jan 25 22:23:17 umbrel systemd[1]: Stopped Umbrel Startup Service.
Jan 25 22:23:17 umbrel systemd[1]: Starting Umbrel Startup Service…
Jan 25 22:23:17 umbrel umbrel startup[1372]: parse error: Unfinished string at EOF at line 1, column 1044
Jan 25 22:23:17 umbrel systemd[1]: umbrel-startup.service: Control process exited, code=exited, status=4/NOPERMISSION
Jan 25 22:23:17 umbrel systemd[1]: umbrel-startup.service: Failed with result ‘exit-code’.
Jan 25 22:23:17 umbrel systemd[1]: Failed to start Umbrel Startup Service.
Jan 25 22:23:27 umbrel systemd[1]: umbrel-startup.service: Service RestartSec=10s expired, scheduling restart.
Jan 25 22:23:27 umbrel systemd[1]: umbrel-startup.service: Scheduled restart job, restart counter is at 2.
Jan 25 22:23:27 umbrel systemd[1]: Stopped Umbrel Startup Service.
Jan 25 22:23:27 umbrel systemd[1]: Starting Umbrel Startup Service…
Jan 25 22:23:27 umbrel umbrel startup[1453]: parse error: Unfinished string at EOF at line 1, column 1044
Jan 25 22:23:27 umbrel systemd[1]: umbrel-startup.service: Control process exited, code=exited, status=4/NOPERMISSION
Jan 25 22:23:27 umbrel systemd[1]: umbrel-startup.service: Failed with result ‘exit-code’.
Jan 25 22:23:27 umbrel systemd[1]: Failed to start Umbrel Startup Service.

External storage service logs

Jan 25 22:22:19 umbrel external storage mounter[506]: Found device “WD Elements 2621”
Jan 25 22:22:19 umbrel external storage mounter[506]: Blacklisting USB device IDs against UAS driver…
Jan 25 22:22:19 umbrel external storage mounter[506]: Rebinding USB drivers…
Jan 25 22:22:19 umbrel external storage mounter[506]: Checking USB devices are back…
Jan 25 22:22:19 umbrel external storage mounter[506]: Waiting for USB devices…
Jan 25 22:22:20 umbrel external storage mounter[506]: Waiting for USB devices…
Jan 25 22:22:21 umbrel external storage mounter[506]: Waiting for USB devices…
Jan 25 22:22:22 umbrel external storage mounter[506]: Checking if the device is ext4…
Jan 25 22:22:22 umbrel external storage mounter[506]: Yes, it is ext4
Jan 25 22:22:22 umbrel external storage mounter[506]: Checking filesystem for corruption…
Jan 25 22:22:22 umbrel external storage mounter[506]: e2fsck 1.44.5 (15-Dec-2018)
Jan 25 22:22:25 umbrel external storage mounter[506]: umbrel: recovering journal
Jan 25 22:22:30 umbrel external storage mounter[506]: umbrel: clean, 296167/244187136 files, 202566242/976745728 blocks
Jan 25 22:22:30 umbrel external storage mounter[506]: Mounting partition…
Jan 25 22:22:30 umbrel external storage mounter[506]: Checking if device contains an Umbrel install…
Jan 25 22:22:30 umbrel external storage mounter[506]: Yes, it contains an Umbrel install
Jan 25 22:22:30 umbrel external storage mounter[506]: Bind mounting external storage over local Umbrel installation…
Jan 25 22:22:30 umbrel external storage mounter[506]: Bind mounting external storage over local Docker data dir…
Jan 25 22:22:30 umbrel external storage mounter[506]: Bind mounting external storage to /swap
Jan 25 22:22:30 umbrel external storage mounter[506]: Bind mounting SD card root at /sd-card…
Jan 25 22:22:30 umbrel external storage mounter[506]: Checking Umbrel root is now on external storage…
Jan 25 22:22:31 umbrel external storage mounter[506]: Checking /var/lib/docker is now on external storage…
Jan 25 22:22:31 umbrel external storage mounter[506]: Checking /swap is now on external storage…
Jan 25 22:22:31 umbrel external storage mounter[506]: Setting up swapfile
Jan 25 22:22:44 umbrel external storage mounter[506]: Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)
Jan 25 22:22:44 umbrel external storage mounter[506]: no label, UUID=ebb232dc-eb47-429d-abf7-77190ad95bdc
Jan 25 22:22:44 umbrel external storage mounter[506]: Checking SD Card root is bind mounted at /sd-root…
Jan 25 22:22:44 umbrel external storage mounter[506]: Starting external drive mount monitor…
Jan 25 22:22:44 umbrel external storage mounter[506]: Mount script completed successfully!
Jan 25 22:22:44 umbrel systemd[1]: Started External Storage Mounter.

External storage SD card update service logs

– Logs begin at Thu 2024-01-25 22:22:14 UTC, end at Thu 2024-01-25 22:23:32 UTC. –
Jan 25 22:23:06 umbrel systemd[1]: Starting External Storage SDcard Updater…
Jan 25 22:23:06 umbrel external storage updater[1016]: Checking if SD card Umbrel is newer than external storage…
Jan 25 22:23:06 umbrel external storage updater[1016]: No, SD version is not newer, exiting.
Jan 25 22:23:06 umbrel systemd[1]: Started External Storage SDcard Updater.

Karen logs

Pulling api … extracting (42.1%)
Pulling api … extracting (47.7%)
Pulling api … extracting (51.9%)
Pulling api … extracting (57.5%)
Pulling api … extracting (64.5%)
Pulling api … extracting (74.3%)
Pulling api … extracting (79.9%)
Pulling api … extracting (91.1%)
Pulling api … extracting (96.7%)
Pulling api … extracting (100.0%)
Pulling api … pull complete
Pulling api … extracting (1.1%)
Pulling api … extracting (5.3%)
Pulling api … extracting (9.5%)
Pulling api … extracting (12.6%)
Pulling api … extracting (17.9%)
Pulling api … extracting (23.1%)
Pulling api … extracting (29.4%)
Pulling api … extracting (35.7%)
Pulling api … extracting (42.0%)
Pulling api … extracting (47.3%)
Pulling api … extracting (52.6%)
Pulling api … extracting (56.8%)
Pulling api … extracting (61.0%)
Pulling api … extracting (65.2%)
Pulling api … extracting (69.4%)
Pulling api … extracting (73.6%)
Pulling api … extracting (76.7%)
Pulling api … extracting (79.9%)
Pulling api … extracting (83.0%)
Pulling api … extracting (86.2%)
Pulling api … extracting (89.3%)
Pulling api … extracting (92.5%)
Pulling api … extracting (95.7%)
Pulling api … extracting (98.8%)
Pulling api … extracting (100.0%)
Pulling api … pull complete
Pulling api … extracting (100.0%)
Pulling api … extracting (100.0%)
Pulling api … pull complete
Pulling api … digest: sha256:c58996a3bfd382cb78…
Pulling api … status: downloaded newer image fo…
Pulling api … done
Starting app mempool…
Creating mempool_app_proxy_1 …
Creating mempool_api_1 …
Creating mempool_tor_server_1 …
Creating mempool_web_1 …
Creating mempool_mariadb_1 …

Docker containers

Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?

Umbrel logs

Traceback (most recent call last):
File “/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py”, line 802, in urlopen
**response_kw,
File “/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py”, line 504, in _make_request
enforce_content_length=enforce_content_length,
File “/usr/local/lib/python3.7/dist-packages/urllib3/connection.py”, line 395, in request
self.endheaders()
File “/usr/lib/python3.7/http/client.py”, line 1259, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File “/usr/lib/python3.7/http/client.py”, line 1034, in _send_output
self.send(msg)
File “/usr/lib/python3.7/http/client.py”, line 974, in send
self.connect()
File “/usr/local/lib/python3.7/dist-packages/docker/transport/unixconn.py”, line 27, in connect
sock.connect(self.unix_socket)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File “/usr/local/lib/python3.7/dist-packages/requests/adapters.py”, line 497, in send
chunked=chunked,
File “/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py”, line 845, in urlopen
method, url, error=new_e, _pool=self, _stacktrace=sys.exc_info()[2]
File “/usr/local/lib/python3.7/dist-packages/urllib3/util/retry.py”, line 470, in increment
raise reraise(type(error), error, _stacktrace)
File “/usr/local/lib/python3.7/dist-packages/urllib3/util/util.py”, line 38, in reraise
raise value.with_traceback(tb)
File “/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py”, line 802, in urlopen
**response_kw,
File “/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py”, line 504, in _make_request
enforce_content_length=enforce_content_length,
File “/usr/local/lib/python3.7/dist-packages/urllib3/connection.py”, line 395, in request
self.endheaders()
File “/usr/lib/python3.7/http/client.py”, line 1259, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File “/usr/lib/python3.7/http/client.py”, line 1034, in _send_output
self.send(msg)
File “/usr/lib/python3.7/http/client.py”, line 974, in send
self.connect()
File “/usr/local/lib/python3.7/dist-packages/docker/transport/unixconn.py”, line 27, in connect
sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: (‘Connection aborted.’, ConnectionRefusedError(111, ‘Connection refused’))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File “/usr/local/lib/python3.7/dist-packages/docker/api/client.py”, line 214, in _retrieve_server_version
return self.version(api_version=False)[“ApiVersion”]
File “/usr/local/lib/python3.7/dist-packages/docker/api/daemon.py”, line 181, in version
return self._result(self._get(url), json=True)
File “/usr/local/lib/python3.7/dist-packages/docker/utils/decorators.py”, line 46, in inner
return f(self, *args, **kwargs)
File “/usr/local/lib/python3.7/dist-packages/docker/api/client.py”, line 237, in _get
return self.get(url, **self._set_request_timeout(kwargs))
File “/usr/local/lib/python3.7/dist-packages/requests/sessions.py”, line 602, in get
return self.request(“GET”, url, **kwargs)
File “/usr/local/lib/python3.7/dist-packages/requests/sessions.py”, line 589, in request
resp = self.send(prep, **send_kwargs)
File “/usr/local/lib/python3.7/dist-packages/requests/sessions.py”, line 703, in send
r = adapter.send(request, **kwargs)
File “/usr/local/lib/python3.7/dist-packages/requests/adapters.py”, line 501, in send
raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: (‘Connection aborted.’, ConnectionRefusedError(111, ‘Connection refused’))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File “/usr/local/bin/docker-compose”, line 8, in
sys.exit(main())
File “/usr/local/lib/python3.7/dist-packages/compose/cli/main.py”, line 81, in main
command_func()
File “/usr/local/lib/python3.7/dist-packages/compose/cli/main.py”, line 200, in perform_command
project = project_from_options(‘.’, options)
File “/usr/local/lib/python3.7/dist-packages/compose/cli/command.py”, line 70, in project_from_options
enabled_profiles=get_profiles_from_options(options, environment)
File “/usr/local/lib/python3.7/dist-packages/compose/cli/command.py”, line 153, in get_project
verbose=verbose, version=api_version, context=context, environment=environment
File “/usr/local/lib/python3.7/dist-packages/compose/cli/docker_client.py”, line 43, in get_client
environment=environment, tls_version=get_tls_version(environment)
File “/usr/local/lib/python3.7/dist-packages/compose/cli/docker_client.py”, line 170, in docker_client
client = APIClient(use_ssh_client=not use_paramiko_ssh, **kwargs)
File “/usr/local/lib/python3.7/dist-packages/docker/api/client.py”, line 197, in init
self._version = self._retrieve_server_version()
File “/usr/local/lib/python3.7/dist-packages/docker/api/client.py”, line 222, in _retrieve_server_version
f’Error while fetching server API version: {e}’
docker.errors.DockerException: Error while fetching server API version: (‘Connection aborted.’, ConnectionRefusedError(111, ‘Connection refused’))

Tor Proxy logs

Traceback (most recent call last):
File “/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py”, line 802, in urlopen
**response_kw,
File “/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py”, line 504, in _make_request
enforce_content_length=enforce_content_length,
File “/usr/local/lib/python3.7/dist-packages/urllib3/connection.py”, line 395, in request
self.endheaders()
File “/usr/lib/python3.7/http/client.py”, line 1259, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File “/usr/lib/python3.7/http/client.py”, line 1034, in _send_output
self.send(msg)
File “/usr/lib/python3.7/http/client.py”, line 974, in send
self.connect()
File “/usr/local/lib/python3.7/dist-packages/docker/transport/unixconn.py”, line 27, in connect
sock.connect(self.unix_socket)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File “/usr/local/lib/python3.7/dist-packages/requests/adapters.py”, line 497, in send
chunked=chunked,
File “/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py”, line 845, in urlopen
method, url, error=new_e, _pool=self, _stacktrace=sys.exc_info()[2]
File “/usr/local/lib/python3.7/dist-packages/urllib3/util/retry.py”, line 470, in increment
raise reraise(type(error), error, _stacktrace)
File “/usr/local/lib/python3.7/dist-packages/urllib3/util/util.py”, line 38, in reraise
raise value.with_traceback(tb)
File “/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py”, line 802, in urlopen
**response_kw,
File “/usr/local/lib/python3.7/dist-packages/urllib3/connectionpool.py”, line 504, in _make_request
enforce_content_length=enforce_content_length,
File “/usr/local/lib/python3.7/dist-packages/urllib3/connection.py”, line 395, in request
self.endheaders()
File “/usr/lib/python3.7/http/client.py”, line 1259, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File “/usr/lib/python3.7/http/client.py”, line 1034, in _send_output
self.send(msg)
File “/usr/lib/python3.7/http/client.py”, line 974, in send
self.connect()
File “/usr/local/lib/python3.7/dist-packages/docker/transport/unixconn.py”, line 27, in connect
sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: (‘Connection aborted.’, ConnectionRefusedError(111, ‘Connection refused’))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File “/usr/local/lib/python3.7/dist-packages/docker/api/client.py”, line 214, in _retrieve_server_version
return self.version(api_version=False)[“ApiVersion”]
File “/usr/local/lib/python3.7/dist-packages/docker/api/daemon.py”, line 181, in version
return self._result(self._get(url), json=True)
File “/usr/local/lib/python3.7/dist-packages/docker/utils/decorators.py”, line 46, in inner
return f(self, *args, **kwargs)
File “/usr/local/lib/python3.7/dist-packages/docker/api/client.py”, line 237, in _get
return self.get(url, **self._set_request_timeout(kwargs))
File “/usr/local/lib/python3.7/dist-packages/requests/sessions.py”, line 602, in get
return self.request(“GET”, url, **kwargs)
File “/usr/local/lib/python3.7/dist-packages/requests/sessions.py”, line 589, in request
resp = self.send(prep, **send_kwargs)
File “/usr/local/lib/python3.7/dist-packages/requests/sessions.py”, line 703, in send
r = adapter.send(request, **kwargs)
File “/usr/local/lib/python3.7/dist-packages/requests/adapters.py”, line 501, in send
raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: (‘Connection aborted.’, ConnectionRefusedError(111, ‘Connection refused’))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File “/usr/local/bin/docker-compose”, line 8, in
sys.exit(main())
File “/usr/local/lib/python3.7/dist-packages/compose/cli/main.py”, line 81, in main
command_func()
File “/usr/local/lib/python3.7/dist-packages/compose/cli/main.py”, line 200, in perform_command
project = project_from_options(‘.’, options)
File “/usr/local/lib/python3.7/dist-packages/compose/cli/command.py”, line 70, in project_from_options
enabled_profiles=get_profiles_from_options(options, environment)
File “/usr/local/lib/python3.7/dist-packages/compose/cli/command.py”, line 153, in get_project
verbose=verbose, version=api_version, context=context, environment=environment
File “/usr/local/lib/python3.7/dist-packages/compose/cli/docker_client.py”, line 43, in get_client
environment=environment, tls_version=get_tls_version(environment)
File “/usr/local/lib/python3.7/dist-packages/compose/cli/docker_client.py”, line 170, in docker_client
client = APIClient(use_ssh_client=not use_paramiko_ssh, **kwargs)
File “/usr/local/lib/python3.7/dist-packages/docker/api/client.py”, line 197, in init
self._version = self._retrieve_server_version()
File “/usr/local/lib/python3.7/dist-packages/docker/api/client.py”, line 222, in _retrieve_server_version
f’Error while fetching server API version: {e}’
docker.errors.DockerException: Error while fetching server API version: (‘Connection aborted.’, ConnectionRefusedError(111, ‘Connection refused’))
parse error: Unfinished string at EOF at line 1, column 1044

==== Result ====

==== END =====
Connection to umbrel.local closed.

Thanks for you help

Anyone with an advice on how to retrieve the funds sent to the lightning wallet?