intermittent boot issues on OrangePI Zero3 - incorrect DRAM detect

HI, I built a system for my OrangePI Zero3 1GB using buildroot. It boots fine for the most part. But sometimes stalls as follows:
```
U-Boot SPL 2021.07 (Dec 20 2023 - 11:38:06 +0000)
DRAM: 2048 MiB
Trying to boot from MMC1
```
Note that this time it detected 2048 MiB memory.. I then have to reboot until it correctly detects the 1048 memory.. which boots successfully.