Error: System service failed after moving and replugging in

Running Umbrel on The Bitcoin Machine.

Moved homes so I had to unplug my node. When I plug into new home, I get this error:

Logs are below…

=====================
= Umbrel debug info =

Umbrel version

0.5.3

Flashed OS version

v0.4.4

Raspberry Pi Model

Revision : d03114
Serial : 100000007ffb3163
Model : Raspberry Pi 4 Model B Rev 1.4

Firmware

Sep 28 2021 11:27:35
Copyright (c) 2012 Broadcom
version 778b6a4f3c7d8d48bb63c02c47bcfbac79417bea (clean) (release) (start)

Temperature

temp=46.7’C

Throttling

throttled=0x0

Memory usage

          total        used        free      shared  buff/cache   available

Mem: 7.8G 244M 7.2G 8.0M 416M 7.4G
Swap: 4.1G 0B 4.1G

ƒtotal: 3.1%
system: 3.1%
snort: 0%
samourai-server: 0%
mempool: 0%
lightning: 0%
electrs: 0%
btcpay-server: 0%
bitcoin: 0%

Memory monitor logs

2019-02-14 02:12:47 Memory monitor running!
2019-02-14 02:12:17 Memory monitor running!
2019-02-14 02:12:32 Memory monitor running!
2019-02-14 02:12:46 Memory monitor running!
2019-02-14 02:13:00 Memory monitor running!
2019-02-14 02:13:13 Memory monitor running!
2019-02-14 02:13:27 Memory monitor running!
2019-02-14 02:13:40 Memory monitor running!
2019-02-14 02:13:54 Memory monitor running!
2019-02-14 02:14:09 Memory monitor running!

Filesystem information

Filesystem Size Used Avail Use% Mounted on
/dev/root 29G 29G 0 100% /
/dev/sda1 916G 646G 224G 75% /home/umbrel/umbrel

Startup service logs

Feb 14 02:13:58 umbrel umbrel startup[6196]: ERROR: for tor_server Cannot start service tor_server: write /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db: no space left on device: unknown
Feb 14 02:13:58 umbrel umbrel startup[6196]: ERROR: for dashboard Cannot start service dashboard: write /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db: no space left on device: unknown
Feb 14 02:13:58 umbrel umbrel startup[6196]: ERROR: for manager Cannot start service manager: write /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db: no space left on device: unknown
Feb 14 02:13:58 umbrel umbrel startup[6196]: ERROR: for tor_proxy Cannot start service tor_proxy: write /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db: no space left on device: unknown
Feb 14 02:13:58 umbrel umbrel startup[6196]: ERROR: for auth Cannot start service auth: write /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db: no space left on device: unknown
Feb 14 02:13:58 umbrel umbrel startup[6196]: Encountered errors while bringing up the project.
Feb 14 02:13:58 umbrel umbrel startup[6196]: Failed to start containers
Feb 14 02:13:58 umbrel systemd[1]: umbrel-startup.service: Control process exited, code=exited, status=1/FAILURE
Feb 14 02:13:58 umbrel systemd[1]: umbrel-startup.service: Failed with result ‘exit-code’.
Feb 14 02:13:58 umbrel systemd[1]: Failed to start Umbrel Startup Service.
Feb 14 02:14:08 umbrel systemd[1]: umbrel-startup.service: Service RestartSec=10s expired, scheduling restart.
Feb 14 02:14:08 umbrel systemd[1]: umbrel-startup.service: Scheduled restart job, restart counter is at 8.
Feb 14 02:14:08 umbrel systemd[1]: Stopped Umbrel Startup Service.
Feb 14 02:14:08 umbrel systemd[1]: Starting Umbrel Startup Service…
Feb 14 02:14:09 umbrel umbrel startup[7638]: ======================================
Feb 14 02:14:09 umbrel umbrel startup[7638]: ============= STARTING ===============
Feb 14 02:14:09 umbrel umbrel startup[7638]: ============== UMBREL ================
Feb 14 02:14:09 umbrel umbrel startup[7638]: ======================================
Feb 14 02:14:09 umbrel umbrel startup[7638]: Setting environment variables…
Feb 14 02:14:09 umbrel umbrel startup[7638]: Starting karen…
Feb 14 02:14:09 umbrel umbrel startup[7638]: Starting status monitors…
Feb 14 02:14:09 umbrel umbrel startup[7638]: Starting memory monitor…
Feb 14 02:14:09 umbrel umbrel startup[7638]: Starting backup monitor…
Feb 14 02:14:09 umbrel umbrel startup[7638]: Starting decoy backup trigger…
Feb 14 02:14:09 umbrel umbrel startup[7638]: Starting Docker services…
Feb 14 02:14:11 umbrel umbrel startup[7638]: Starting manager …
Feb 14 02:14:11 umbrel umbrel startup[7638]: Starting auth …
Feb 14 02:14:11 umbrel umbrel startup[7638]: Starting tor_proxy …
Feb 14 02:14:11 umbrel umbrel startup[7638]: Starting tor_server …
Feb 14 02:14:11 umbrel umbrel startup[7638]: Starting dashboard …

External storage service logs

Feb 14 02:12:03 umbrel external storage mounter[522]: Checking USB devices are back…
Feb 14 02:12:03 umbrel external storage mounter[522]: Waiting for USB devices…
Feb 14 02:12:04 umbrel external storage mounter[522]: Waiting for USB devices…
Feb 14 02:12:05 umbrel external storage mounter[522]: Waiting for USB devices…
Feb 14 02:12:06 umbrel external storage mounter[522]: Checking if the device is ext4…
Feb 14 02:12:06 umbrel external storage mounter[522]: Yes, it is ext4
Feb 14 02:12:06 umbrel external storage mounter[522]: Checking filesystem for corruption…
Feb 14 02:12:06 umbrel external storage mounter[522]: e2fsck 1.44.5 (15-Dec-2018)
Feb 14 02:12:07 umbrel external storage mounter[522]: Superblock last mount time is in the future.
Feb 14 02:12:07 umbrel external storage mounter[522]: (by less than a day, probably due to the hardware clock being incorrectly set)
Feb 14 02:12:07 umbrel external storage mounter[522]: Superblock last write time is in the future.
Feb 14 02:12:07 umbrel external storage mounter[522]: (by less than a day, probably due to the hardware clock being incorrectly set)
Feb 14 02:12:07 umbrel external storage mounter[522]: umbrel: clean, 336636/61054976 files, 173297357/244190208 blocks
Feb 14 02:12:07 umbrel external storage mounter[522]: Mounting partition…
Feb 14 02:12:07 umbrel external storage mounter[522]: Checking if device contains an Umbrel install…
Feb 14 02:12:07 umbrel external storage mounter[522]: Yes, it contains an Umbrel install
Feb 14 02:12:07 umbrel external storage mounter[522]: Bind mounting external storage over local Umbrel installation…
Feb 14 02:12:07 umbrel external storage mounter[522]: Bind mounting external storage over local Docker data dir…
Feb 14 02:12:07 umbrel external storage mounter[522]: Bind mounting external storage to /swap
Feb 14 02:12:07 umbrel external storage mounter[522]: Bind mounting SD card root at /sd-card…
Feb 14 02:12:07 umbrel external storage mounter[522]: Checking Umbrel root is now on external storage…
Feb 14 02:12:08 umbrel external storage mounter[522]: Checking /var/lib/docker is now on external storage…
Feb 14 02:12:08 umbrel external storage mounter[522]: Checking /swap is now on external storage…
Feb 14 02:12:08 umbrel external storage mounter[522]: Setting up swapfile
Feb 14 02:12:08 umbrel external storage mounter[522]: Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)
Feb 14 02:12:08 umbrel external storage mounter[522]: no label, UUID=fb0f3fec-e42e-40cc-9b10-b011859dd707
Feb 14 02:12:08 umbrel external storage mounter[522]: Checking SD Card root is bind mounted at /sd-root…
Feb 14 02:12:08 umbrel external storage mounter[522]: Starting external drive mount monitor…
Feb 14 02:12:08 umbrel external storage mounter[522]: Mount script completed successfully!
Feb 14 02:12:08 umbrel systemd[1]: Started External Storage Mounter.

External storage SD card update service logs

Feb 14 02:12:17 umbrel external storage updater[1061]: == Begin Update Script 01-run.sh ==
Feb 14 02:12:17 umbrel external storage updater[1061]: =======================================
Feb 14 02:12:17 umbrel external storage updater[1061]: =============== UPDATE ================
Feb 14 02:12:17 umbrel external storage updater[1061]: =======================================
Feb 14 02:12:17 umbrel external storage updater[1061]: =========== Stage: Install ============
Feb 14 02:12:17 umbrel external storage updater[1061]: =======================================
Feb 14 02:12:17 umbrel external storage updater[1061]: =============================================
Feb 14 02:12:17 umbrel external storage updater[1061]: Installing on Umbrel OS v0.4.4
Feb 14 02:12:17 umbrel external storage updater[1061]: =============================================
Feb 14 02:12:17 umbrel external storage updater[1061]: ./01-run.sh: line 25: cannot create temp file for here-document: No space left on device
Feb 14 02:12:17 umbrel external storage updater[1061]: == End Update Script 01-run.sh ==
Feb 14 02:12:17 umbrel external storage updater[1061]: == Begin Update Script 02-run.sh ==
Feb 14 02:12:17 umbrel external storage updater[1061]: =======================================
Feb 14 02:12:17 umbrel external storage updater[1061]: =============== UPDATE ================
Feb 14 02:12:17 umbrel external storage updater[1061]: =======================================
Feb 14 02:12:17 umbrel external storage updater[1061]: ========= Stage: Post-update ==========
Feb 14 02:12:17 umbrel external storage updater[1061]: =======================================
Feb 14 02:12:17 umbrel external storage updater[1061]: == End Update Script 02-run.sh ==
Feb 14 02:12:17 umbrel external storage updater[1061]: == Begin Update Script 03-run.sh ==
Feb 14 02:12:17 umbrel external storage updater[1061]: =======================================
Feb 14 02:12:17 umbrel external storage updater[1061]: =============== UPDATE ================
Feb 14 02:12:17 umbrel external storage updater[1061]: =======================================
Feb 14 02:12:17 umbrel external storage updater[1061]: =========== Stage: Success ============
Feb 14 02:12:17 umbrel external storage updater[1061]: =======================================
Feb 14 02:12:17 umbrel external storage updater[1061]: Removing backup
Feb 14 02:12:17 umbrel external storage updater[1061]: ./03-run.sh: line 19: cannot create temp file for here-document: No space left on device
Feb 14 02:12:17 umbrel external storage updater[1061]: == End Update Script 03-run.sh ==
Feb 14 02:12:17 umbrel external storage updater[1061]: Deleting cloned repository
Feb 14 02:12:17 umbrel external storage updater[1061]: Removing lock
Feb 14 02:12:17 umbrel systemd[1]: Started External Storage SDcard Updater.

Karen logs

karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events
karen is running in /home/umbrel/umbrel/events

Docker containers

NAMES STATUS

Umbrel logs

Attaching to manager

Tor Proxy logs

Attaching to tor_proxy

App logs

bitcoin

Attaching to

btcpay-server

Attaching to

electrs

Attaching to

lightning

Attaching to

mempool

Attaching to

samourai-server

Attaching to

snort

Attaching to

==== Result ====

The debug script did not automatically detect any issues with your Umbrel.

Hey there,

Have you tried the following guide here? Resolving “Error: System service failed”

don’t forget he’s on a Bitcoin Machine, gotta position that one as it’s chopped up they are different entity no control over it but you’ll basically gonna have to open that thing up and quickest way is swap on the SSD or reformat it, go from there imo

since it’s an old pi 4 absolute quickest resolution replace the storage drive reinstall imo… salvage all the parts…

Careful if reformatting that drive, you’ll lose all data on there now though.