Fortunately that’s not how it works when you have all the access points controlled centrally, like with unifi. Yes there is limited frequency space, but this is much less of an issue on 5ghz. There will also only be one ssid, and handoff between access points is pretty seamless.
3-4 is probably overkill, but the attenuation situation sounded pretty dire. I run two in my house for redundancy mostly, just standard American stud and drywall construction.
If a controller is still connected (Bluetooth?) it may be a controller order issue, you can try reordering them.