Resync on reboot

Been fighting my umbrel for over a month now. Forced a resync, finally completed 100%, everything looked ok except lighting channels were still offline no peers. I rebooted the Pi and upon restart Bitcoin back to 0%.

No idea what to do next.

=====================
= Umbrel debug info =

Umbrel version

0.5.3

Flashed OS version

v0.3.8

Raspberry Pi Model

Revision : c03112
Serial : 1000000012bd7bd2
Model : Raspberry Pi 4 Model B Rev 1.2

Firmware

Feb 25 2021 12:10:40
Copyright © 2012 Broadcom
version 564e5f9b852b23a330b1764bcf0b2d022a20afd0 (clean) (release) (start)

Temperature

temp=39.9’C

Throttling

throttled=0x0

Memory usage

          total        used        free      shared  buff/cache   available

Mem: 3.8G 2.1G 537M 3.0M 1.2G 1.6G
Swap: 4.1G 632M 3.5G

total: 54.1%
mempool: 10.9%
system: 10.3%
bitcoin: 7.4%
lightning: 7.2%
electrs: 7.1%
thunderhub: 4.4%
bluewallet: 3.7%
ride-the-lightning: 2.1%
tailscale: 1%

Memory monitor logs

2023-05-20 13:40:32 Warning memory usage at 93%
2023-05-20 13:45:36 Warning memory usage at 91%
2023-05-20 13:46:36 Warning memory usage at 91%
2023-05-20 13:47:36 Warning memory usage at 93%
2023-05-20 13:50:39 Warning memory usage at 92%
2023-05-20 13:51:41 Warning memory usage at 93%
2023-05-20 13:52:43 Warning memory usage at 92%
2023-05-20 13:53:45 Warning memory usage at 91%
2023-05-20 14:00:48 Warning memory usage at 93%
2023-06-01 17:13:17 Memory monitor running!

Filesystem information

Filesystem Size Used Avail Use% Mounted on
/dev/root 59G 5.2G 51G 10% /
/dev/sda1 1.8T 574G 1.2T 33% /home/umbrel/umbrel

Startup service logs

Jun 01 17:14:09 umbrel umbrel startup[995]: Creating mempool_api_1 … done
Jun 01 17:14:09 umbrel umbrel startup[995]: Creating ride-the-lightning_app_proxy_1 … done
Jun 01 17:14:11 umbrel umbrel startup[995]: Creating bluewallet_tor_server_1 … done
Jun 01 17:14:12 umbrel umbrel startup[995]: Creating lightning_app_proxy_1 … done
Jun 01 17:14:12 umbrel umbrel startup[995]: Creating mempool_app_proxy_1 … done
Jun 01 17:14:12 umbrel umbrel startup[995]: Creating lightning_tor_1 … done
Jun 01 17:14:13 umbrel umbrel startup[995]: Creating bluewallet_redis_1 … done
Jun 01 17:14:13 umbrel umbrel startup[995]: Creating bluewallet_lndhub_1 …
Jun 01 17:14:14 umbrel umbrel startup[995]: Creating electrs_tor_server_1 … done
Jun 01 17:14:14 umbrel umbrel startup[995]: Creating bitcoin_i2pd_daemon_1 … done
Jun 01 17:14:15 umbrel umbrel startup[995]: Creating electrs_tor_1 … done
Jun 01 17:14:15 umbrel umbrel startup[995]: Creating bitcoin_tor_server_1 … done
Jun 01 17:14:15 umbrel umbrel startup[995]: Creating bitcoin_tor_1 … done
Jun 01 17:14:15 umbrel umbrel startup[995]: Creating bitcoin_app_proxy_1 … done
Jun 01 17:14:16 umbrel umbrel startup[995]: Creating electrs_app_proxy_1 … done
Jun 01 17:14:16 umbrel umbrel startup[995]: Creating bluewallet_app_proxy_1 … done
Jun 01 17:14:17 umbrel umbrel startup[995]: Creating electrs_electrs_1 … done
Jun 01 17:14:17 umbrel umbrel startup[995]: Creating electrs_app_1 …
Jun 01 17:14:17 umbrel umbrel startup[995]: Creating bitcoin_bitcoind_1 … done
Jun 01 17:14:17 umbrel umbrel startup[995]: Creating bitcoin_server_1 …
Jun 01 17:14:17 umbrel umbrel startup[995]: Creating lightning_lnd_1 … done
Jun 01 17:14:20 umbrel umbrel startup[995]: Creating bluewallet_lndhub_1 … done
Jun 01 17:14:23 umbrel umbrel startup[995]: Creating electrs_app_1 … done
Jun 01 17:14:24 umbrel umbrel startup[995]: Creating bitcoin_server_1 … done
Jun 01 17:14:24 umbrel umbrel startup[995]: Umbrel is now accessible at
Jun 01 17:14:24 umbrel umbrel startup[995]: http://umbrel.local
Jun 01 17:14:24 umbrel umbrel startup[995]: http://192.168.10.4
Jun 01 17:14:24 umbrel systemd[1]: Started Umbrel Startup Service.
Jun 01 17:15:14 umbrel passwd[10535]: pam_unix(passwd:chauthtok): password changed for umbrel

External storage service logs

Jun 01 17:13:03 umbrel external storage mounter[504]: No block devices found
Jun 01 17:13:03 umbrel external storage mounter[504]: Waiting for 5 seconds before checking again…
Jun 01 17:13:08 umbrel external storage mounter[504]: Found device “External USB3.0”
Jun 01 17:13:08 umbrel external storage mounter[504]: Blacklisting USB device IDs against UAS driver…
Jun 01 17:13:08 umbrel external storage mounter[504]: Rebinding USB drivers…
Jun 01 17:13:08 umbrel external storage mounter[504]: Checking USB devices are back…
Jun 01 17:13:08 umbrel external storage mounter[504]: Waiting for USB devices…
Jun 01 17:13:09 umbrel external storage mounter[504]: Waiting for USB devices…
Jun 01 17:13:10 umbrel external storage mounter[504]: Checking if the device is ext4…
Jun 01 17:13:10 umbrel external storage mounter[504]: Yes, it is ext4
Jun 01 17:13:10 umbrel external storage mounter[504]: Checking filesystem for corruption…
Jun 01 17:13:10 umbrel external storage mounter[504]: e2fsck 1.44.5 (15-Dec-2018)
Jun 01 17:13:11 umbrel external storage mounter[504]: umbrel: clean, 461881/122101760 files, 170461028/488378368 blocks
Jun 01 17:13:11 umbrel external storage mounter[504]: Mounting partition…
Jun 01 17:13:11 umbrel external storage mounter[504]: Checking if device contains an Umbrel install…
Jun 01 17:13:11 umbrel external storage mounter[504]: Yes, it contains an Umbrel install
Jun 01 17:13:11 umbrel external storage mounter[504]: Bind mounting external storage over local Umbrel installation…
Jun 01 17:13:11 umbrel external storage mounter[504]: Bind mounting external storage over local Docker data dir…
Jun 01 17:13:11 umbrel external storage mounter[504]: Bind mounting external storage to /swap
Jun 01 17:13:11 umbrel external storage mounter[504]: Bind mounting SD card root at /sd-card…
Jun 01 17:13:11 umbrel external storage mounter[504]: Checking Umbrel root is now on external storage…
Jun 01 17:13:13 umbrel external storage mounter[504]: Checking /var/lib/docker is now on external storage…
Jun 01 17:13:13 umbrel external storage mounter[504]: Checking /swap is now on external storage…
Jun 01 17:13:13 umbrel external storage mounter[504]: Setting up swapfile
Jun 01 17:13:13 umbrel external storage mounter[504]: Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)
Jun 01 17:13:13 umbrel external storage mounter[504]: no label, UUID=9fc9c1df-0925-485d-949d-d62b36e3e215
Jun 01 17:13:13 umbrel external storage mounter[504]: Checking SD Card root is bind mounted at /sd-root…
Jun 01 17:13:13 umbrel external storage mounter[504]: Starting external drive mount monitor…
Jun 01 17:13:13 umbrel external storage mounter[504]: Mount script completed successfully!
Jun 01 17:13:13 umbrel systemd[1]: Started External Storage Mounter.

External storage SD card update service logs

– Logs begin at Thu 2023-06-01 17:12:53 UTC, end at Thu 2023-06-01 17:22:42 UTC. –
Jun 01 17:13:16 umbrel systemd[1]: Starting External Storage SDcard Updater…
Jun 01 17:13:16 umbrel external storage updater[918]: Checking if SD card Umbrel is newer than external storage…
Jun 01 17:13:17 umbrel external storage updater[918]: No, SD version is not newer, exiting.
Jun 01 17:13:17 umbrel systemd[1]: Started External Storage SDcard Updater.

Karen logs

Removing bitcoin_tor_1 …
Removing bitcoin_tor_server_1 …
Removing bitcoin_app_proxy_1 …
Removing bitcoin_i2pd_daemon_1 … done
Removing bitcoin_tor_1 … done
Removing bitcoin_tor_server_1 … done
Removing bitcoin_app_proxy_1 … done
Removing bitcoin_bitcoind_1 … done
Removing bitcoin_server_1 … done
Going to remove bitcoin_server_1, bitcoin_i2pd_daemon_1, bitcoin_bitcoind_1, bitcoin_tor_1, bitcoin_tor_server_1, bitcoin_app_proxy_1

Stopping Docker services…

Stopping nginx …
Stopping auth …
Stopping tor_server …
Stopping manager …
Stopping dashboard …
Stopping tor_proxy …
Stopping tor_proxy … done
Stopping nginx … done
Stopping tor_server … done
Stopping auth … done
Stopping dashboard … done
Stopping manager … done
Removing nginx …
Removing auth …
Removing tor_server …
Removing manager …
Removing dashboard …
Removing tor_proxy …
Removing dashboard … done
Removing nginx … done
Removing tor_server … done
Removing tor_proxy … done
Removing auth … done
Removing manager … done
Removing network umbrel_main_network
karen is running in /home/umbrel/umbrel/events
Got signal:
karen is getting triggered!
./karen: line 75: /home/umbrel/umbrel/events/triggers/: Is a directory
Got signal:
karen is getting triggered!
./karen: line 75: /home/umbrel/umbrel/events/triggers/: Is a directory
Got signal: change-password
karen is getting triggered!
New password: Retype new password: passwd: password updated successfully
Got signal: debug
karen is getting triggered!

Docker containers

NAMES STATUS
bitcoin_server_1 Up 9 minutes
electrs_app_1 Up 9 minutes
bluewallet_lndhub_1 Up 8 minutes
electrs_electrs_1 Up 59 seconds
electrs_tor_server_1 Up 9 minutes
electrs_tor_1 Up 9 minutes
electrs_app_proxy_1 Up 9 minutes
bitcoin_i2pd_daemon_1 Up 9 minutes
bitcoin_tor_server_1 Up 9 minutes
bluewallet_tor_server_1 Up 9 minutes
bluewallet_redis_1 Up 9 minutes
bitcoin_bitcoind_1 Up 56 seconds
bitcoin_tor_1 Up 9 minutes
bitcoin_app_proxy_1 Up 9 minutes
lightning_tor_1 Up 9 minutes
bluewallet_app_proxy_1 Up 9 minutes
lightning_lnd_1 Up 9 minutes
lightning_app_1 Up 9 minutes
lightning_app_proxy_1 Up 9 minutes
lightning_tor_server_1 Up 9 minutes
mempool_api_1 Up 9 minutes
ride-the-lightning_web_1 Up 9 minutes
mempool_mariadb_1 Up 9 minutes
mempool_app_proxy_1 Up 9 minutes
ride-the-lightning_app_proxy_1 Up 9 minutes
ride-the-lightning_boltz_1 Up 9 minutes
ride-the-lightning_tor_server_1 Up 9 minutes
mempool_tor_server_1 Up 9 minutes
mempool_web_1 Up 9 minutes
tailscale_web_1 Up 9 minutes
tailscale_tor_server_1 Restarting (1) 45 seconds ago
thunderhub_app_proxy_1 Up 9 minutes
thunderhub_tor_server_1 Up 9 minutes
thunderhub_web_1 Up 9 minutes
nginx Up 10 minutes
tor_proxy Up 10 minutes
manager Up 10 minutes
dashboard Up 10 minutes
auth Up 10 minutes
tor_server Up 10 minutes

Umbrel logs

Attaching to manager
manager | ::ffff:10.21.21.2 - - [Thu, 01 Jun 2023 17:23:25 GMT] “GET /v1/system/debug-result HTTP/1.0” 304 - “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/113.0”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.0.18 - - [Thu, 01 Jun 2023 17:23:26 GMT] “GET /v1/account/token?token=443eed1611fdffbcccc0a376803a531566493038912963f557089eb772a2433a HTTP/1.1” 200 16 “-” “app-proxy/0.0.1”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.21.2 - - [Thu, 01 Jun 2023 17:23:26 GMT] “GET /v1/system/debug-result HTTP/1.0” 304 - “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/113.0”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.0.18 - - [Thu, 01 Jun 2023 17:23:27 GMT] “GET /v1/account/token?token=443eed1611fdffbcccc0a376803a531566493038912963f557089eb772a2433a HTTP/1.1” 200 16 “-” “app-proxy/0.0.1”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.21.2 - - [Thu, 01 Jun 2023 17:23:27 GMT] “GET /v1/system/debug-result HTTP/1.0” 304 - “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/113.0”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.0.18 - - [Thu, 01 Jun 2023 17:23:28 GMT] “GET /v1/account/token?token=443eed1611fdffbcccc0a376803a531566493038912963f557089eb772a2433a HTTP/1.1” 200 16 “-” “app-proxy/0.0.1”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.21.2 - - [Thu, 01 Jun 2023 17:23:28 GMT] “GET /v1/system/debug-result HTTP/1.0” 304 - “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/113.0”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.0.18 - - [Thu, 01 Jun 2023 17:23:29 GMT] “GET /v1/account/token?token=443eed1611fdffbcccc0a376803a531566493038912963f557089eb772a2433a HTTP/1.1” 200 16 “-” “app-proxy/0.0.1”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.0.18 - - [Thu, 01 Jun 2023 17:23:29 GMT] “GET /v1/account/token?token=443eed1611fdffbcccc0a376803a531566493038912963f557089eb772a2433a HTTP/1.1” 200 16 “-” “app-proxy/0.0.1”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.0.18 - - [Thu, 01 Jun 2023 17:23:29 GMT] “GET /v1/account/token?token=443eed1611fdffbcccc0a376803a531566493038912963f557089eb772a2433a HTTP/1.1” 200 16 “-” “app-proxy/0.0.1”
manager |
manager | umbrel-manager

Tor Proxy logs

Attaching to tor_proxy
tor_proxy | Jun 01 17:13:49.000 [notice] Bootstrapped 61% (loading_descriptors): Loading relay descriptors
tor_proxy | Jun 01 17:13:49.000 [notice] Bootstrapped 68% (loading_descriptors): Loading relay descriptors
tor_proxy | Jun 01 17:13:50.000 [notice] Bootstrapped 75% (enough_dirinfo): Loaded enough directory info to build circuits
tor_proxy | Jun 01 17:13:50.000 [notice] Bootstrapped 80% (ap_conn): Connecting to a relay to build circuits
tor_proxy | Jun 01 17:13:50.000 [notice] Bootstrapped 85% (ap_conn_done): Connected to a relay to build circuits
tor_proxy | Jun 01 17:13:50.000 [notice] Bootstrapped 89% (ap_handshake): Finishing handshake with a relay to build circuits
tor_proxy | Jun 01 17:13:51.000 [notice] Bootstrapped 90% (ap_handshake_done): Handshake finished with a relay to build circuits
tor_proxy | Jun 01 17:13:51.000 [notice] Bootstrapped 95% (circuit_create): Establishing a Tor circuit
tor_proxy | Jun 01 17:13:52.000 [notice] Bootstrapped 100% (done): Done
tor_proxy | Jun 01 17:15:27.000 [notice] New control connection opened from 10.21.21.9.

App logs

bitcoin

Attaching to bitcoin_server_1, bitcoin_i2pd_daemon_1, bitcoin_tor_server_1, bitcoin_bitcoind_1, bitcoin_tor_1, bitcoin_app_proxy_1
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
bitcoind_1 | 2023-06-01T17:22:58Z Loaded 119742 blocks from external file in 25669ms
bitcoind_1 | 2023-06-01T17:22:58Z Reindexing block file blk00001.dat…
bitcoind_1 | 2023-06-01T17:23:00Z New outbound peer connected: version: 70016, blocks=792406, peer=6 (outbound-full-relay)
bitcoind_1 | 2023-06-01T17:23:00Z New outbound peer connected: version: 70016, blocks=792406, peer=7 (outbound-full-relay)
bitcoind_1 | 2023-06-01T17:23:07Z New outbound peer connected: version: 70016, blocks=792406, peer=9 (outbound-full-relay)
bitcoind_1 | 2023-06-01T17:23:09Z New outbound peer connected: version: 70016, blocks=792406, peer=8 (outbound-full-relay)
bitcoind_1 | 2023-06-01T17:23:13Z Loaded 11453 blocks from external file in 14618ms
bitcoind_1 | 2023-06-01T17:23:13Z Reindexing block file blk00002.dat…
bitcoind_1 | 2023-06-01T17:23:27Z Loaded 5677 blocks from external file in 14152ms
bitcoind_1 | 2023-06-01T17:23:27Z Reindexing block file blk00003.dat…
server_1 | umbrel-middleware
server_1 | ::ffff:10.21.0.18 - - [Thu, 01 Jun 2023 17:23:31 GMT] “GET /v1/bitcoind/info/sync HTTP/1.1” 200 100 “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/113.0”
server_1 |
server_1 | umbrel-middleware
server_1 | ::ffff:10.21.0.18 - - [Thu, 01 Jun 2023 17:23:32 GMT] “GET /v1/bitcoind/info/sync HTTP/1.1” 200 100 “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/113.0”
server_1 |
server_1 | umbrel-middleware
server_1 | ::ffff:10.21.0.18 - - [Thu, 01 Jun 2023 17:23:33 GMT] “GET /v1/bitcoind/info/sync HTTP/1.1” 200 100 “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/113.0”
server_1 |
server_1 | umbrel-middleware
i2pd_daemon_1 | 17:15:12@171/error - Garlic: Can’t handle ECIES-X25519-AEAD-Ratchet message
i2pd_daemon_1 | 17:15:15@609/error - Tunnels: Can’t select next hop for 9OmnAaVQLOXpiXjk59thimRYraYCJoIP2pIKosSdeW0=
i2pd_daemon_1 | 17:15:15@609/error - Tunnels: Can’t create inbound tunnel, no peers available
i2pd_daemon_1 | 17:16:30@609/error - Tunnels: Can’t select next hop for If2vVWu0ZpYlIKxpk9EGyRXzW7~cVL1mN02AY68uXtI=
i2pd_daemon_1 | 17:16:30@609/error - Tunnels: Can’t create inbound tunnel, no peers available
i2pd_daemon_1 | 17:16:45@609/error - Tunnels: Can’t select next hop for ~Aho8~JfvFnoQQqw14XLfd7zuoVAgCV~Z6-KUUKdQNc=
i2pd_daemon_1 | 17:16:45@609/error - Tunnels: Can’t create inbound tunnel, no peers available
i2pd_daemon_1 | 17:18:00@207/error - Addressbook: LeaseSet for address reg.i2p not found
i2pd_daemon_1 | 17:18:00@476/error - Garlic: Can’t handle ECIES-X25519-AEAD-Ratchet message
i2pd_daemon_1 | 17:23:06@476/error - Garlic: Can’t handle ECIES-X25519-AEAD-Ratchet message
tor_1 | Jun 01 17:14:56.000 [notice] Bootstrapped 95% (circuit_create): Establishing a Tor circuit
tor_1 | Jun 01 17:14:58.000 [notice] Bootstrapped 100% (done): Done
tor_1 | Jun 01 17:15:33.000 [notice] Have tried resolving or connecting to address ‘[scrubbed]’ at 3 different places. Giving up.
tor_1 | Jun 01 17:15:36.000 [notice] Have tried resolving or connecting to address ‘[scrubbed]’ at 3 different places. Giving up.
tor_1 | Jun 01 17:16:02.000 [notice] Have tried resolving or connecting to address ‘[scrubbed]’ at 3 different places. Giving up.
tor_1 | Jun 01 17:16:33.000 [notice] Have tried resolving or connecting to address ‘[scrubbed]’ at 3 different places. Giving up.
tor_1 | Jun 01 17:20:03.000 [notice] Have tried resolving or connecting to address ‘[scrubbed]’ at 3 different places. Giving up.

bluewallet

Attaching to bluewallet_lndhub_1, bluewallet_tor_server_1, bluewallet_redis_1, bluewallet_app_proxy_1
app_proxy_1 | yarn run v1.22.19
app_proxy_1 | $ node ./bin/www
app_proxy_1 | [HPM] Proxy created: / -> http://10.21.21.30:3008
app_proxy_1 | Waiting for 10.21.21.30:3008 to open…
app_proxy_1 | BlueWallet Lightning is now ready…
app_proxy_1 | Listening on port: 3008
app_proxy_1 | [HPM] Error occurred while proxying request umbrel.local:3008/ to http://10.21.21.30:3008/ [ECONNRESET] (https://nodejs.org/api/errors.html#errors_common_system_errors)
lndhub_1 | updateLightning()
lndhub_1 | updated
lndhub_1 | updateLightning()
lndhub_1 | updated
lndhub_1 | updateLightning()
lndhub_1 | updated
lndhub_1 | updateLightning()
lndhub_1 | updated
lndhub_1 | updateLightning()
lndhub_1 | updated
redis_1 | 7:C 01 Jun 2023 17:14:13.634 # Configuration loaded
redis_1 | 7:M 01 Jun 2023 17:14:13.636 * monotonic clock: POSIX clock_gettime
redis_1 | 7:M 01 Jun 2023 17:14:13.643 * Running mode=standalone, port=6379.
redis_1 | 7:M 01 Jun 2023 17:14:13.643 # Server initialized
redis_1 | 7:M 01 Jun 2023 17:14:13.643 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add ‘vm.overcommit_memory = 1’ to /etc/sysctl.conf and then reboot or run the command ‘sysctl vm.overcommit_memory=1’ for this to take effect.
redis_1 | 7:M 01 Jun 2023 17:14:13.807 * Loading RDB produced by version 6.2.2
redis_1 | 7:M 01 Jun 2023 17:14:13.808 * RDB age 152 seconds
redis_1 | 7:M 01 Jun 2023 17:14:13.808 * RDB memory usage when created 0.96 Mb
redis_1 | 7:M 01 Jun 2023 17:14:13.817 * DB loaded from disk: 0.073 seconds
redis_1 | 7:M 01 Jun 2023 17:14:13.817 * Ready to accept connections

electrs

Attaching to electrs_app_1, electrs_electrs_1, electrs_tor_server_1, electrs_tor_1, electrs_app_proxy_1
app_1 | at ElectrumClient.onClose (/app/node_modules/@lily-technologies/electrum-client/lib/client.js:229:44)
app_1 | at ElectrumClient.onClose (/app/node_modules/@lily-technologies/electrum-client/index.js:69:9)
app_1 | at Socket. (/app/node_modules/@lily-technologies/electrum-client/lib/client.js:60:9)
app_1 | at Socket.emit (node:events:527:28)
app_1 | at TCP. (node:net:709:12)
app_1 | ::ffff:10.21.0.19 - - [Thu, 01 Jun 2023 17:19:04 GMT] “GET /v1/electrs/version HTTP/1.1” 500 2 “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/113.0”
app_1 |
app_1 | umbrel-middleware
app_1 | Electrum attempting reconnect…
app_1 | Electrum attempting reconnect…
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
app_proxy_1 | Validating token: 443eed1611fd …
electrs_1 | [2023-06-01T17:23:28.672Z INFO electrs::daemon] waiting for 137013 blocks to download (IBD)
electrs_1 | [2023-06-01T17:23:29.680Z INFO electrs::daemon] waiting for 137526 blocks to download (IBD)
electrs_1 | [2023-06-01T17:23:30.919Z INFO electrs::daemon] waiting for 137867 blocks to download (IBD)
electrs_1 | [2023-06-01T17:23:31.927Z INFO electrs::daemon] waiting for 138418 blocks to download (IBD)
electrs_1 | [2023-06-01T17:23:32.935Z INFO electrs::daemon] waiting for 139030 blocks to download (IBD)
electrs_1 | [2023-06-01T17:23:33.944Z INFO electrs::daemon] waiting for 139185 blocks to download (IBD)
electrs_1 | [2023-06-01T17:23:34.951Z INFO electrs::daemon] waiting for 139587 blocks to download (IBD)
electrs_1 | [2023-06-01T17:23:36.472Z INFO electrs::daemon] waiting for 139912 blocks to download (IBD)
electrs_1 | [2023-06-01T17:23:37.481Z INFO electrs::daemon] waiting for 140374 blocks to download (IBD)
electrs_1 | [2023-06-01T17:23:39.235Z INFO electrs::daemon] waiting for 140938 blocks to download (IBD)
tor_1 | Jun 01 17:14:45.000 [notice] Bootstrapped 56% (loading_descriptors): Loading relay descriptors
tor_1 | Jun 01 17:14:48.000 [notice] Bootstrapped 63% (loading_descriptors): Loading relay descriptors
tor_1 | Jun 01 17:14:50.000 [notice] Bootstrapped 73% (loading_descriptors): Loading relay descriptors
tor_1 | Jun 01 17:14:52.000 [notice] Bootstrapped 75% (enough_dirinfo): Loaded enough directory info to build circuits
tor_1 | Jun 01 17:14:52.000 [notice] Bootstrapped 80% (ap_conn): Connecting to a relay to build circuits
tor_1 | Jun 01 17:14:52.000 [notice] Bootstrapped 85% (ap_conn_done): Connected to a relay to build circuits
tor_1 | Jun 01 17:14:53.000 [notice] Bootstrapped 89% (ap_handshake): Finishing handshake with a relay to build circuits
tor_1 | Jun 01 17:14:53.000 [notice] Bootstrapped 90% (ap_handshake_done): Handshake finished with a relay to build circuits
tor_1 | Jun 01 17:14:53.000 [notice] Bootstrapped 95% (circuit_create): Establishing a Tor circuit
tor_1 | Jun 01 17:14:53.000 [notice] Bootstrapped 100% (done): Done

lightning

Attaching to lightning_tor_1, lightning_lnd_1, lightning_app_1, lightning_app_proxy_1, lightning_tor_server_1
app_1 | Checking LND status…
app_1 | LND already unlocked!
app_1 | [backup-monitor] Checking channel backup…
app_1 | [backup-monitor] Sleeping…
app_1 | Checking LND status…
app_1 | LND already unlocked!
app_1 | Checking LND status…
app_1 | LND already unlocked!
app_1 | Checking LND status…
app_1 | LND already unlocked!
app_proxy_1 | yarn run v1.22.19
app_proxy_1 | $ node ./bin/www
app_proxy_1 | [HPM] Proxy created: / -> http://10.21.22.3:3006
app_proxy_1 | Waiting for 10.21.22.3:3006 to open…
app_proxy_1 | Lightning Node is now ready…
app_proxy_1 | Listening on port: 2101
lnd_1 | 2023-06-01 17:15:27.220 [INF] HSWC: Trimming open circuits for chan_id=695067:403:1, start_htlc_id=37
lnd_1 | 2023-06-01 17:15:27.220 [INF] HSWC: Trimming open circuits for chan_id=778420:1046:1, start_htlc_id=74
lnd_1 | 2023-06-01 17:15:27.220 [INF] HSWC: Trimming open circuits for chan_id=738197:1344:1, start_htlc_id=181
lnd_1 | 2023-06-01 17:15:27.220 [INF] HSWC: Trimming open circuits for chan_id=764636:1467:1, start_htlc_id=186
lnd_1 | 2023-06-01 17:15:27.385 [INF] LTND: Channel backup proxy channel notifier starting
lnd_1 | 2023-06-01 17:15:27.388 [INF] ATPL: Instantiating autopilot with active=false, max_channels=5, allocation=0.600000, min_chan_size=20000, max_chan_size=16777215, private=false, min_confs=1, conf_target=3
lnd_1 | 2023-06-01 17:15:27.391 [INF] LTND: We’re not running within systemd or the service type is not ‘notify’
lnd_1 | 2023-06-01 17:15:27.394 [INF] LTND: Waiting for chain backend to finish sync, start_height=0
lnd_1 | 2023-06-01 17:15:39.947 [INF] INVC: New invoice subscription client: id=1
lnd_1 | 2023-06-01 17:15:41.688 [INF] INVC: New invoice subscription client: id=2
tor_1 | Jun 01 17:14:50.000 [notice] Bootstrapped 55% (loading_descriptors): Loading relay descriptors
tor_1 | Jun 01 17:14:52.000 [notice] Bootstrapped 60% (loading_descriptors): Loading relay descriptors
tor_1 | Jun 01 17:14:54.000 [notice] Bootstrapped 68% (loading_descriptors): Loading relay descriptors
tor_1 | Jun 01 17:14:54.000 [notice] Bootstrapped 75% (enough_dirinfo): Loaded enough directory info to build circuits
tor_1 | Jun 01 17:14:54.000 [notice] Bootstrapped 80% (ap_conn): Connecting to a relay to build circuits
tor_1 | Jun 01 17:14:55.000 [notice] Bootstrapped 85% (ap_conn_done): Connected to a relay to build circuits
tor_1 | Jun 01 17:14:56.000 [notice] Bootstrapped 89% (ap_handshake): Finishing handshake with a relay to build circuits
tor_1 | Jun 01 17:14:56.000 [notice] Bootstrapped 90% (ap_handshake_done): Handshake finished with a relay to build circuits
tor_1 | Jun 01 17:14:56.000 [notice] Bootstrapped 95% (circuit_create): Establishing a Tor circuit
tor_1 | Jun 01 17:14:56.000 [notice] Bootstrapped 100% (done): Done

mempool

Attaching to mempool_api_1, mempool_mariadb_1, mempool_app_proxy_1, mempool_tor_server_1, mempool_web_1
api_1 | Jun 1 17:19:04 [118] ERR: Error connecting to Electrum Server at 10.21.21.10:50001
api_1 | Jun 1 17:19:08 [118] WARN: Exception in runMainUpdateLoop(). Retrying in 10 sec. Reason: connect ECONNREFUSED 10.21.21.8:8332. Stack trace: Error: connect ECONNREFUSED 10.21.21.8:8332
api_1 | at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1187:16)
api_1 | Jun 1 17:19:18 [118] NOTICE: The mempool is now in sync!
api_1 | Jun 1 17:21:28 [118] INFO: Starting lightning network forensics service
api_1 | Jun 1 17:21:28 [118] INFO: Running forensics scans
api_1 | Jun 1 17:21:28 [118] INFO: [Lightning] Caching funding txs for currently existing channels
api_1 | Jun 1 17:21:28 [118] INFO: Lightning topology folder is not set. Not importing historical LN stats
api_1 | Jun 1 17:22:25 [118] INFO: Disconnected from Electrum Server at 10.21.21.10:50001
api_1 | Jun 1 17:22:25 [118] ERR: Electrum error: {}
app_proxy_1 | yarn run v1.22.19
app_proxy_1 | $ node ./bin/www
app_proxy_1 | [HPM] Proxy created: / -> http://10.21.21.26:3006
app_proxy_1 | Waiting for 10.21.21.26:3006 to open…
app_proxy_1 | mempool is now ready…
app_proxy_1 | Listening on port: 3006
web_1 | /var/www/mempool/browser/resources
mariadb_1 | 2023-06-01 17:14:12 0 [Note] Plugin ‘FEEDBACK’ is disabled.
mariadb_1 | 2023-06-01 17:14:13 0 [Note] Server socket created on IP: ‘::’.
mariadb_1 | 2023-06-01 17:14:13 0 [Warning] ‘proxies_priv’ entry ‘@% root@b548d8ab65b3’ ignored in --skip-name-resolve mode.
mariadb_1 | 2023-06-01 17:14:13 0 [Note] Reading of all Master_info entries succeeded
mariadb_1 | 2023-06-01 17:14:13 0 [Note] Added new Master_info ‘’ to hash table
mariadb_1 | 2023-06-01 17:14:13 0 [Note] mysqld: ready for connections.
mariadb_1 | Version: ‘10.5.12-MariaDB-1:10.5.12+maria~focal’ socket: ‘/run/mysqld/mysqld.sock’ port: 3306 mariadb.org binary distribution
mariadb_1 | 2023-06-01 17:14:13 3 [Warning] Aborted connection 3 to db: ‘unconnected’ user: ‘unauthenticated’ host: ‘10.21.21.26’ (This connection closed normally without authentication)
mariadb_1 | 2023-06-01 17:14:13 4 [Warning] Aborted connection 4 to db: ‘unconnected’ user: ‘unauthenticated’ host: ‘10.21.21.27’ (This connection closed normally without authentication)
mariadb_1 | 2023-06-01 17:14:16 0 [Note] InnoDB: Buffer pool(s) load completed at 230601 17:14:16

Did you manage to fix it?

Mine resyncs from 0 after each reboot