ESP32 Odd BLE Bonding

[Elisium]

Hello!
I'm trying to connect my esp32 via BT BLE to my android phone, i'm using the "usual" configuration with BLEDevice BLEServer and so on, the strange part is that the phone can bond to the device, but it does not connect. (will usually appear blue when connected).
I also tried multiple options to connect through an app (react native and flutter) and no luck detecting the bonded device.
I need the phone to connect to an already bonded device, because if multiple esp32 are advertising, the phone will connect to the first one it appears, and not actually the one you want.
I also have done some tests with BLESecurity with no luck.

Has someone experienced the same issues as me? How can I solve this problem?
Thanks