umbrelOS 1.2.1 (x86) crashes after few days

I’m posting this as a new topic in hopes of getting an answer…
It’s been more than a month since I made the switch from version 0.5, which has always worked perfectly. Unfortunately, every 2/3/4 days the server crashes, and the only way to restart it is to unplug.
Would there be a way to understand what causes the problem?

And the log, after restart, say this:
x86/split lock detection: #AC: crashing the kernel on kernel split_locks and warning on user-space split_locks

And most of the time it crashes after trying to update the apps:

Jul 09 21:35:58 umbrel umbreld[5220]: [apprepository] Checking for update for https://github.com/getumbrel/umbrel-apps.git
Jul 09 21:35:58 umbrel umbreld[5220]: [apprepository] https://github.com/getumbrel/umbrel-apps.git is already up to date
-- Boot 00b881237f554c86a34def224c468240 --
Jul 10 09:52:08 umbrel kernel: microcode: microcode updated early to revision 0x24000024, date = 2022-09-02
Jul 10 09:52:08 umbrel kernel: Linux version 6.1.0-21-amd64 (debian-kernel@lists.debian.org) (gcc-12 (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC Debian 6.1.90-1 (2024-05-03)
Jul 10 09:52:08 umbrel kernel: Command line: BOOT_IMAGE=/boot/kernel root=PARTUUID=f5e6d27c-4a25-447b-8e08-a9d2e738345a loglevel=3
Jul 10 09:52:08 umbrel kernel: x86/split lock detection: #AC: crashing the kernel on kernel split_locks and warning on user-space split_locks

Could we prevent it from automatically checking for updates for now???

But isn’t there paid support? From the log I can see when it crashes, but I have no idea what to do…
Why isn’t developer support possible?
Reinstalling from scratch is not an option!

Hey @pauerbuk, Are you using a Umbrel Home? If not can you post the specs of your machine also have you noticed what applications are attempting to update when the crash happens?

Also can you upload the complete logs. Can you upload the logs? You can get them by going to settings > troubleshoot > umbrelOS then click on View umbrelOS Logs and Download umbrelOS logs and I’ll give them a look.

Thanks cws0016. Here are the last lines of the log, before and after the reboot.
umbrel-1721376415057.log (2.0 MB)

The curious thing is that it always crashes after checking the umbrel-apps update, and after restarting it always appears

x86/split lock detection: #AC: crashing the kernel on kernel split_locks and warning on user-space split_lock

I don’t understand much about it though… :pensive:

Hey @pauerbuk, I am looking over the logs. As I am looking over to see whats going on can I get your specs still not 100% certain as to what hardware your using can you upload your specs? I wanna see if the hardware itself has any known issues with the linux kernel.

“Fanless Mini PC, Intel Celeron N5100 16GB RAM 512GB SSD”
It shouldn’t, it worked for a year with Umbrel 0.5 installed on 1TB SSD with Ubuntu.
The only thing I replaced when I upgraded to Umbrel 1.2 was the Samsung SSD 870 EVO 2TB drive

I have another thing we can try to try and isolate whats going on. Do you have a monitor connected to your Mini PC. If so before you pull the power are you able to access umbrelOS directly not through the browser?

Unfortunately not, that’s blocked too

Hi @pauerbuk I think I have to agree with @cws0016. I took a look at your logs, not a log reading expert, but usually when you see a log cut off without any panic or kernel info, that’s usually a hardware related failure. The kernel hardware fault handler (assuming it was run) cannot safely access resources and therefore cannot write logs (among other things). There are multiple levels of fault handlers that are registered with varying levels of resource awareness. However, this usually leans to faults such as power or connection issues.

You mentioned swapping the OS disk drive during your upgrade, a temporary loss of drive connection could be related to the lack of logging into too.

Any chance you could swap a different drive in for the time being? I know you said a full install is not an option, but copying your data is rather straight forward and you shouldn’t lose anything!