I think I found the answer. The home directory (/home/umbrel) was actually preserved after upgrade. What was lost was stuff in /mnt/data/umbrel. This feels counterintuitive to me for some reason, but it is what it is.
So I’ll leave this here, just in case somebody ever wonders. Store data that you want to keep around in /home/umbrel.