Lightning Node Broke and it is stuck loading

image

I restarted umbrel from both app and command line, dont know what else to do. It was routing this morning.

=====================
= Umbrel debug info =

Umbrel version

0.5.4

Memory usage

           total        used        free      shared  buff/cache   available

Mem: 12G 3,1G 660M 5,0M 9,1G 9,4G
Swap: 2,0G 1,6G 446M

bitcoin: 653 1%
mempool: 71%
lightning: 32 1%
total: 24,3%
electrs: 3 1%
tailscale: 01%
system: %

Memory monitor logs

2024-05-24 14:52:18 Memory monitor running!
2024-05-26 04:37:18 Memory monitor running!
2024-05-26 06:50:59 Memory monitor running!
2024-05-26 07:36:01 Memory monitor running!
2024-05-26 09:22:54 Memory monitor running!
2024-05-26 13:16:41 Memory monitor running!
551487 ? S 0:00 bash ./scripts/memory-monitor
Memory monitor is already running
2024-05-26 13:34:40 Memory monitor running!
2024-05-26 13:57:00 Memory monitor running!

Filesystem information

Filesystem Size Used Avail Use% Mounted on
/dev/nvme0n1p2 37G 22G 13G 64% /
/dev/md0 879G 727G 108G 88% /media/ezml-umbrel/Raid-umbrel

Karen logs

Removing electrs_tor_1 … done
Removing electrs_app_proxy_1 … done
Removing electrs_app_1 … done
Going to remove electrs_app_1, electrs_tor_1, electrs_electrs_1, electrs_app_proxy_1
Stopping bitcoin_bitcoind_1 … done
Stopping bitcoin_i2pd_daemon_1 … done
Removing bitcoin_server_1 …
Removing bitcoin_app_proxy_1 …
Removing bitcoin_i2pd_daemon_1 …
Removing bitcoin_bitcoind_1 …
Removing bitcoin_tor_1 …
Removing bitcoin_bitcoind_1 … done
Removing bitcoin_i2pd_daemon_1 … done
Removing bitcoin_tor_1 … done
Removing bitcoin_app_proxy_1 … done
Removing bitcoin_server_1 … done
Going to remove bitcoin_server_1, bitcoin_app_proxy_1, bitcoin_i2pd_daemon_1, bitcoin_bitcoind_1, bitcoin_tor_1

Stopping Docker services…

Stopping nginx …
Stopping manager …
Stopping auth …
Stopping dashboard …
Stopping tor_proxy …
Stopping nginx … done
Stopping tor_proxy … done
Stopping auth … done
Stopping dashboard … done
Stopping manager … done
Removing nginx …
Removing manager …
Removing auth …
Removing dashboard …
Removing tor_proxy …
Removing dashboard … done
Removing nginx … done
Removing tor_proxy … done
Removing auth … done
Removing manager … done
Removing network umbrel_main_network
karen is running in /media/ezml-umbrel/Raid-umbrel/umbrel/events
Got signal:
karen is getting triggered!
./karen: line 75: /media/ezml-umbrel/Raid-umbrel/umbrel/events/triggers/: Is a directory
Got signal: change-password
karen is getting triggered!
This script must only be run on Umbrel OS
Got signal: debug
karen is getting triggered!

Docker containers

NAMES STATUS
electrs_app_1 Up 11 minutes
bitcoin_server_1 Up 11 minutes
mempool_mariadb_1 Up 11 minutes
mempool_api_1 Up 11 minutes
mempool_web_1 Up 11 minutes
mempool_app_proxy_1 Up 11 minutes
electrs_app_proxy_1 Up 11 minutes
electrs_tor_1 Up 11 minutes
bitcoin_bitcoind_1 Up 11 minutes
bitcoin_i2pd_daemon_1 Up 11 minutes
bitcoin_tor_1 Up 11 minutes
electrs_electrs_1 Up 11 minutes
bitcoin_app_proxy_1 Up 11 minutes
lightning_lnd_1 Restarting (2) 11 seconds ago
lightning_app_1 Up 11 minutes
lightning_tor_1 Up 11 minutes
lightning_app_proxy_1 Up 11 minutes
tailscale_web_1 Up 11 minutes
nginx Up 11 minutes
auth Up 11 minutes
manager Up 11 minutes
dashboard Up 11 minutes
tor_proxy Up 11 minutes

Umbrel logs

Attaching to manager
manager | ::ffff:10.21.21.2 - - [Sun, 26 May 2024 17:08:15 GMT] “GET /v1/system/info HTTP/1.0” 304 - “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.21.2 - - [Sun, 26 May 2024 17:08:15 GMT] “GET /v1/system/uptime HTTP/1.0” 200 3 “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.21.2 - - [Sun, 26 May 2024 17:08:15 GMT] “GET /v1/apps?installed=1 HTTP/1.0” 304 - “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.21.2 - - [Sun, 26 May 2024 17:08:15 GMT] “GET /v1/apps HTTP/1.0” 304 - “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.21.2 - - [Sun, 26 May 2024 17:08:18 GMT] “POST /v1/system/debug HTTP/1.0” 200 17 “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.21.2 - - [Sun, 26 May 2024 17:08:19 GMT] “GET /v1/system/debug-result HTTP/1.0” 200 23 “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.21.2 - - [Sun, 26 May 2024 17:08:20 GMT] “GET /v1/system/debug-result HTTP/1.0” 304 - “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.21.2 - - [Sun, 26 May 2024 17:08:21 GMT] “GET /v1/system/debug-result HTTP/1.0” 304 - “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.0.7 - - [Sun, 26 May 2024 17:08:21 GMT] “GET /v1/account/token?token=3f34a01ebbaa93aa23954aacb2974e2de10c0e0f7ba612b3a6fec792185a99d3 HTTP/1.1” 200 16 “-” “app-proxy/0.0.1”
manager |
manager | umbrel-manager
manager | ::ffff:10.21.0.7 - - [Sun, 26 May 2024 17:08:22 GMT] “GET /v1/account/token?token=01fea38286f1d21b6f89b9fd6b37ec428f9dc74e4efe0db84d60f420cf54ff41 HTTP/1.1” 200 16 “-” “app-proxy/0.0.1”
manager |
manager | umbrel-manager

Tor Proxy logs

Attaching to tor_proxy
tor_proxy | May 26 16:57:14.000 [notice] Bootstrapped 55% (loading_descriptors): Loading relay descriptors
tor_proxy | May 26 16:57:15.000 [notice] Bootstrapped 61% (loading_descriptors): Loading relay descriptors
tor_proxy | May 26 16:57:15.000 [notice] Bootstrapped 69% (loading_descriptors): Loading relay descriptors
tor_proxy | May 26 16:57:15.000 [notice] Bootstrapped 75% (enough_dirinfo): Loaded enough directory info to build circuits
tor_proxy | May 26 16:57:15.000 [notice] Bootstrapped 80% (ap_conn): Connecting to a relay to build circuits
tor_proxy | May 26 16:57:15.000 [notice] Bootstrapped 85% (ap_conn_done): Connected to a relay to build circuits
tor_proxy | May 26 16:57:16.000 [notice] Bootstrapped 89% (ap_handshake): Finishing handshake with a relay to build circuits
tor_proxy | May 26 16:57:16.000 [notice] Bootstrapped 90% (ap_handshake_done): Handshake finished with a relay to build circuits
tor_proxy | May 26 16:57:16.000 [notice] Bootstrapped 95% (circuit_create): Establishing a Tor circuit
tor_proxy | May 26 16:57:19.000 [notice] Bootstrapped 100% (done): Done

App logs

bitcoin

Attaching to bitcoin_server_1, bitcoin_bitcoind_1, bitcoin_i2pd_daemon_1, bitcoin_tor_1, bitcoin_app_proxy_1
i2pd_daemon_1 | 16:59:23@860/error - Tunnels: Can’t select next hop for b4DJsmju73uDSjP2UwJ0uOw9CSVad2UsK0PBPfPu6sQ=
i2pd_daemon_1 | 16:59:23@860/error - Tunnels: Can’t create inbound tunnel, no peers available
i2pd_daemon_1 | 17:03:06@31/error - SSU2: RelayIntro unknown router to introduce
i2pd_daemon_1 | 17:03:23@860/error - Tunnels: Can’t select next hop for y2abREC51QZmeYFR8pCYNFrhAym52F-GdNYI2Fc-RCs=
i2pd_daemon_1 | 17:03:23@860/error - Tunnels: Can’t create inbound tunnel, no peers available
i2pd_daemon_1 | 17:03:43@860/error - Tunnels: Can’t select next hop for bsHAJWvHY9cdVwJrhByTwX5PzrNXGqYcvxbvKM4I~fE=
i2pd_daemon_1 | 17:03:43@860/error - Tunnels: Can’t create inbound tunnel, no peers available
i2pd_daemon_1 | 17:04:04@31/error - SSU2: RelayIntro unknown router to introduce
i2pd_daemon_1 | 17:07:38@585/error - Garlic: Can’t handle ECIES-X25519-AEAD-Ratchet message
i2pd_daemon_1 | 17:08:04@667/error - Destination: Can’t publish LeaseSet. Destination is not ready
bitcoind_1 | 2024-05-26T17:05:09Z New outbound-full-relay v1 peer connected: version: 70016, blocks=845257, peer=13
bitcoind_1 | 2024-05-26T17:05:25Z Saw new header hash=00000000000000000001de732b0b22a1b19763fc011c1fe689f5ea7fbbad1d07 height=845258
bitcoind_1 | 2024-05-26T17:05:28Z UpdateTip: new best=00000000000000000001de732b0b22a1b19763fc011c1fe689f5ea7fbbad1d07 height=845258 version=0x20600000 log2_work=94.948128 tx=1012123592 date=‘2024-05-26T17:05:17Z’ progress=1.000000 cache=54.0MiB(444626txo)
bitcoind_1 | 2024-05-26T17:05:45Z Socks5() connect to 154.198.215.102:8333 failed: connection refused
bitcoind_1 | 2024-05-26T17:05:48Z New outbound-full-relay v1 peer connected: version: 70016, blocks=845258, peer=16
bitcoind_1 | 2024-05-26T17:05:48Z Socks5() connect to 170.75.163.48:39388 failed: connection refused
bitcoind_1 | 2024-05-26T17:05:51Z New outbound-full-relay v1 peer connected: version: 70016, blocks=845258, peer=17
bitcoind_1 | 2024-05-26T17:06:07Z New outbound-full-relay v1 peer connected: version: 70016, blocks=845258, peer=18
bitcoind_1 | 2024-05-26T17:06:34Z New outbound-full-relay v1 peer connected: version: 70016, blocks=845258, peer=21
bitcoind_1 | 2024-05-26T17:07:09Z New block-relay-only v2 peer connected: version: 70016, blocks=845258, peer=22
server_1 | umbrel-middleware
server_1 | ::ffff:10.21.0.6 - - [Sun, 26 May 2024 17:07:42 GMT] “GET /v1/bitcoind/info/connections HTTP/1.1” 200 66 “-” “Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36”
server_1 |
server_1 | umbrel-middleware
server_1 | ::ffff:10.21.0.6 - - [Sun, 26 May 2024 17:07:42 GMT] “GET /v1/bitcoind/info/sync HTTP/1.1” 200 103 “-” “Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36”
server_1 |
server_1 | umbrel-middleware
server_1 | ::ffff:10.21.0.6 - - [Sun, 26 May 2024 17:07:42 GMT] “GET /v1/bitcoind/info/stats HTTP/1.1” 200 127 “-” “Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36”
server_1 |
server_1 | umbrel-middleware
app_proxy_1 | Validating token: 01fea38286f1 …
app_proxy_1 | Validating token: 01fea38286f1 …
app_proxy_1 | Validating token: 01fea38286f1 …
app_proxy_1 | Validating token: 01fea38286f1 …
app_proxy_1 | Validating token: 01fea38286f1 …
app_proxy_1 | Validating token: 01fea38286f1 …
app_proxy_1 | Validating token: 01fea38286f1 …
app_proxy_1 | Validating token: 01fea38286f1 …
app_proxy_1 | Validating token: 01fea38286f1 …
app_proxy_1 | Validating token: 01fea38286f1 …
tor_1 | May 26 16:57:20.000 [notice] Bootstrapped 60% (loading_descriptors): Loading relay descriptors
tor_1 | May 26 16:57:21.000 [notice] Bootstrapped 68% (loading_descriptors): Loading relay descriptors
tor_1 | May 26 16:57:21.000 [notice] Bootstrapped 75% (enough_dirinfo): Loaded enough directory info to build circuits
tor_1 | May 26 16:57:21.000 [notice] Bootstrapped 80% (ap_conn): Connecting to a relay to build circuits
tor_1 | May 26 16:57:22.000 [notice] Bootstrapped 85% (ap_conn_done): Connected to a relay to build circuits
tor_1 | May 26 16:57:22.000 [notice] Bootstrapped 89% (ap_handshake): Finishing handshake with a relay to build circuits
tor_1 | May 26 16:57:22.000 [notice] Bootstrapped 90% (ap_handshake_done): Handshake finished with a relay to build circuits
tor_1 | May 26 16:57:22.000 [notice] Bootstrapped 95% (circuit_create): Establishing a Tor circuit
tor_1 | May 26 16:57:23.000 [notice] Bootstrapped 100% (done): Done
tor_1 | May 26 16:59:23.000 [notice] Have tried resolving or connecting to address ‘[scrubbed]’ at 3 different places. Giving up.

electrs

Attaching to electrs_app_1, electrs_app_proxy_1, electrs_tor_1, electrs_electrs_1
app_1 | > umbrel-electrs@1.0.1 dev:backend
app_1 | > npm run start -w umbrel-electrs-backend
app_1 |
app_1 |
app_1 | > umbrel-electrs-backend@0.1.12 start
app_1 | > node ./bin/www
app_1 |
app_1 | Sun, 26 May 2024 16:57:07 GMT morgan deprecated morgan(options): use morgan(“default”, options) instead at app.js:28:9
app_1 | Sun, 26 May 2024 16:57:07 GMT morgan deprecated default format: use combined format at app.js:28:9
app_1 | Listening on port 3006
app_proxy_1 | yarn run v1.22.19
app_proxy_1 | $ node ./bin/www
app_proxy_1 | [HPM] Proxy created: / → http://10.21.22.4:3006
app_proxy_1 | Waiting for 10.21.22.4:3006 to open…
app_proxy_1 | Electrs is now ready…
app_proxy_1 | Listening on port: 2102
electrs_1 | [2024-05-26T16:57:05.807Z INFO electrs::db] “/data/db/bitcoin”: 217 SST files, 47.598124662 GB, 5.958164425 Grows
electrs_1 | [2024-05-26T16:57:07.007Z INFO electrs::chain] loading 845255 headers, tip=000000000000000000025744aa2aed34736b276ed163c749a0d29c9c4c4a0ab8
electrs_1 | [2024-05-26T16:57:07.738Z INFO electrs::chain] chain updated: tip=000000000000000000025744aa2aed34736b276ed163c749a0d29c9c4c4a0ab8, height=845255
electrs_1 | [2024-05-26T16:58:44.356Z WARN electrs::mempool] mempool sync failed: batch request failed
electrs_1 | [2024-05-26T16:58:53.667Z INFO electrs::index] indexing 1 blocks: [845256…845256]
electrs_1 | [2024-05-26T16:58:53.830Z INFO electrs::chain] chain updated: tip=00000000000000000002544ae7a2ed9bccfbf4fd14e99583a37c03f91fc6c222, height=845256
electrs_1 | [2024-05-26T16:59:44.074Z INFO electrs::index] indexing 1 blocks: [845257…845257]
electrs_1 | [2024-05-26T16:59:44.206Z INFO electrs::chain] chain updated: tip=0000000000000000000191f2c84976997e4bf489601de507352cccbf3de433c4, height=845257
electrs_1 | [2024-05-26T17:05:28.938Z INFO electrs::index] indexing 1 blocks: [845258…845258]
electrs_1 | [2024-05-26T17:05:28.966Z INFO electrs::chain] chain updated: tip=00000000000000000001de732b0b22a1b19763fc011c1fe689f5ea7fbbad1d07, height=845258
tor_1 | May 26 16:57:26.000 [notice] Bootstrapped 55% (loading_descriptors): Loading relay descriptors
tor_1 | May 26 16:57:26.000 [notice] Bootstrapped 60% (loading_descriptors): Loading relay descriptors
tor_1 | May 26 16:57:26.000 [notice] Bootstrapped 69% (loading_descriptors): Loading relay descriptors
tor_1 | May 26 16:57:26.000 [notice] Bootstrapped 75% (enough_dirinfo): Loaded enough directory info to build circuits
tor_1 | May 26 16:57:26.000 [notice] Bootstrapped 80% (ap_conn): Connecting to a relay to build circuits
tor_1 | May 26 16:59:41.000 [notice] Bootstrapped 85% (ap_conn_done): Connected to a relay to build circuits
tor_1 | May 26 16:59:42.000 [notice] Bootstrapped 89% (ap_handshake): Finishing handshake with a relay to build circuits
tor_1 | May 26 16:59:42.000 [notice] Bootstrapped 90% (ap_handshake_done): Handshake finished with a relay to build circuits
tor_1 | May 26 16:59:42.000 [notice] Bootstrapped 95% (circuit_create): Establishing a Tor circuit
tor_1 | May 26 16:59:44.000 [notice] Bootstrapped 100% (done): Done

lightning

Attaching to lightning_lnd_1, lightning_app_1, lightning_tor_1, lightning_app_proxy_1
app_1 | umbrel-lightning
app_1 | Checking LND status…
app_1 | ::ffff:10.21.0.7 - - [Sun, 26 May 2024 17:08:24 GMT] “GET /v1/lnd/info/status HTTP/1.1” 304 - “-” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36”
app_1 |
app_1 | umbrel-lightning
app_1 | Waiting for LND…
app_1 | ::ffff:10.21.0.7 - - [Sun, 26 May 2024 17:08:24 GMT] “GET /v1/lnd/info/status HTTP/1.1” 304 - “-” “Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36”
app_1 |
app_1 | umbrel-lightning
app_1 | Checking LND status…
app_proxy_1 | Validating token: 01fea38286f1 …
app_proxy_1 | Validating token: 3f34a01ebbaa …
app_proxy_1 | Validating token: 01fea38286f1 …
app_proxy_1 | Validating token: 3f34a01ebbaa …
app_proxy_1 | Validating token: 01fea38286f1 …
app_proxy_1 | Validating token: 01fea38286f1 …
app_proxy_1 | Validating token: 01fea38286f1 …
app_proxy_1 | Validating token: 3f34a01ebbaa …
app_proxy_1 | Validating token: 3f34a01ebbaa …
app_proxy_1 | Validating token: 01fea38286f1 …
lnd_1 | github.com/lightningnetwork/lnd/kvdb.GetBoltBackend(0xc0008870e8)
lnd_1 | github.com/lightningnetwork/lnd/kvdb@v1.4.4/backend.go:101 +0x7f
lnd_1 | github.com/lightningnetwork/lnd/lncfg.(*DB).GetBackends(0xc000354180, {0x2208090?, 0xc000812000}, {0xc0001ea460, 0x1d}, {0xc00043d2f0, 0x25}, {0xc000bb6330, 0x2a}, 0x1, …)
lnd_1 | github.com/lightningnetwork/lnd/lncfg/db.go:539 +0x311b
lnd_1 | github.com/lightningnetwork/lnd.(*DefaultDatabaseBuilder).BuildDatabase(0xc000016c18, {0x2208090, 0xc000812000})
lnd_1 | github.com/lightningnetwork/lnd/config_builder.go:918 +0x332
lnd_1 | github.com/lightningnetwork/lnd.Main(0xc00044f080, {{0x0?, 0x7f6ef42de7c0?, 0x101c0000ae000?}}, 0xc0000c1020, {0xc000002240, 0xc0000ba3c0, 0xc0000ba420, 0xc0000ba480, {0x0}})
lnd_1 | github.com/lightningnetwork/lnd/lnd.go:427 +0x1d85
lnd_1 | main.main()
lnd_1 | github.com/lightningnetwork/lnd/cmd/lnd/main.go:38 +0x1ee
tor_1 | May 26 16:57:21.000 [notice] Bootstrapped 55% (loading_descriptors): Loading relay descriptors
tor_1 | May 26 16:57:24.000 [notice] Bootstrapped 61% (loading_descriptors): Loading relay descriptors
tor_1 | May 26 16:57:25.000 [notice] Bootstrapped 69% (loading_descriptors): Loading relay descriptors
tor_1 | May 26 16:57:25.000 [notice] Bootstrapped 75% (enough_dirinfo): Loaded enough directory info to build circuits
tor_1 | May 26 16:57:26.000 [notice] Bootstrapped 80% (ap_conn): Connecting to a relay to build circuits
tor_1 | May 26 16:57:26.000 [notice] Bootstrapped 85% (ap_conn_done): Connected to a relay to build circuits
tor_1 | May 26 16:57:26.000 [notice] Bootstrapped 89% (ap_handshake): Finishing handshake with a relay to build circuits
tor_1 | May 26 16:57:26.000 [notice] Bootstrapped 90% (ap_handshake_done): Handshake finished with a relay to build circuits
tor_1 | May 26 16:57:26.000 [notice] Bootstrapped 95% (circuit_create): Establishing a Tor circuit
tor_1 | May 26 16:57:28.000 [notice] Bootstrapped 100% (done): Done

mempool

Attaching to mempool_mariadb_1, mempool_api_1, mempool_web_1, mempool_app_proxy_1
mariadb_1 | 2024-05-26 16:57:06 0 [Note] Plugin ‘FEEDBACK’ is disabled.
mariadb_1 | 2024-05-26 16:57:06 0 [Note] Server socket created on IP: ‘::’.
mariadb_1 | 2024-05-26 16:57:06 0 [Warning] ‘proxies_priv’ entry ‘@% root@95fc9c54d915’ ignored in --skip-name-resolve mode.
mariadb_1 | 2024-05-26 16:57:06 0 [Note] Reading of all Master_info entries succeeded
mariadb_1 | 2024-05-26 16:57:06 0 [Note] Added new Master_info ‘’ to hash table
mariadb_1 | 2024-05-26 16:57:06 0 [Note] mysqld: ready for connections.
mariadb_1 | Version: ‘10.5.12-MariaDB-1:10.5.12+maria~focal’ socket: ‘/run/mysqld/mysqld.sock’ port: 3306 mariadb.org binary distribution
mariadb_1 | 2024-05-26 16:57:06 3 [Warning] Aborted connection 3 to db: ‘unconnected’ user: ‘unauthenticated’ host: ‘10.21.21.26’ (This connection closed normally without authentication)
mariadb_1 | 2024-05-26 16:57:06 0 [Note] InnoDB: Buffer pool(s) load completed at 240526 16:57:06
mariadb_1 | 2024-05-26 16:57:06 4 [Warning] Aborted connection 4 to db: ‘unconnected’ user: ‘unauthenticated’ host: ‘10.21.21.27’ (This connection closed normally without authentication)
app_proxy_1 | yarn run v1.22.19
app_proxy_1 | $ node ./bin/www
app_proxy_1 | [HPM] Proxy created: / → http://10.21.21.26:3006
app_proxy_1 | Waiting for 10.21.21.26:3006 to open…
app_proxy_1 | mempool is now ready…
app_proxy_1 | Listening on port: 3006
app_proxy_1 | [HPM] Upgrading to WebSocket
web_1 | /var/www/mempool/browser/resources
api_1 | May 26 16:57:16 [112] INFO: [Mining] Fetching hourly price history from exchanges and saving missing ones into the database
api_1 | May 26 16:57:16 [112] WARN: Exception in runMainUpdateLoop(). Retrying in 10 sec. Reason: Verifying blocks…. Stack trace: Error: Verifying blocks…
api_1 | at /backend/package/rpc-api/jsonrpc.js:128:35
api_1 | at Array.forEach ()
api_1 | at IncomingMessage. (/backend/package/rpc-api/jsonrpc.js:125:25)
api_1 | at IncomingMessage.emit (node:events:539:35)
api_1 | at endReadableNT (node:internal/streams/readable:1345:12)
api_1 | at processTicksAndRejections (node:internal/process/task_queues:83:21)
api_1 | May 26 16:57:17 [112] INFO: Connected to Electrum Server at 10.21.21.10:50001 ([“electrs/0.10.2”,“1.4”])
api_1 | May 26 16:57:46 [112] WARN: Mempool clear protection triggered because transactions.length: 6973 and currentMempoolSize: 94733.

tailscale

Attaching to tailscale_web_1
web_1 | 2024/05/26 16:57:14 magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)
web_1 | 2024/05/26 16:57:14 magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)
web_1 | 2024/05/26 16:57:14 Rebind; defIf=“enp1s0”, ips=[192.168.0.23/24]
web_1 | 2024/05/26 16:57:14 magicsock: 1 active derp conns: derp-8=cr8s,wr8s
web_1 | 2024/05/26 16:57:14 post-rebind ping of DERP region 8 okay
web_1 | 2024/05/26 16:57:14 portmapper: UPnP meta changed: [{Location:http://192.168.0.1:5000/rootDesc.xml Server:RedHatEnterpriseServer/6.10 UPnP/1.1 MiniUPnPd/1.9 USN:uuid:30393133-3237-3200-0000-acf8cced0c4f::urn:schemas-upnp-org:device:InternetGatewayDevice:1}]
web_1 | 2024/05/26 16:57:14 control: NetInfo: NetInfo{varies=false hairpin=false ipv6=false ipv6os=false udp=true icmpv4=false derp=#8 portmap=U link=“” firewallmode=“”}
web_1 | 2024/05/26 16:57:14 portmapper: saw UPnP type WANIPConnection1 at http://192.168.0.1:5000/rootDesc.xml; ARRIS TG2492LG-85 Router (ARRIS), method=single
web_1 | 2024/05/26 16:57:15 control: NetInfo: NetInfo{varies=false hairpin=false ipv6=false ipv6os=false udp=true icmpv4=false derp=#8 portmap=active-U link=“” firewallmode=“”}
web_1 | 2024/05/26 16:57:15 magicsock: endpoints changed: 86.3.238.100:41151 (portmap), 86.3.238.100:58213 (stun), 86.3.238.100:61966 (portmap), 10.9.0.165:58213 (local), 10.9.9.1:58213 (local), 10.21.0.1:58213 (local), 172.17.0.1:58213 (local), 192.168.0.23:58213 (local)

==== Result ====

==== END =====