A screenshot of my PCB from KiCad
I have one cap either side of the LDO and then two more caps before it enters the ESP32-H2. This is the layout. In terms of being close, I'm currently not sure how close is close enough. The two caps for the LDO are close, but the two for the ESP32 are probably 10mm or 15mm away.