I have exactly the same problem, using as well the WROOM board with built in antenna. I am using the latest version of the libraries, both esp-idf as well as the Zigbee and ZBoss libraries.
Also, I note that operating the esp32c6 as router, it is not very strong in its routing capabilities. Even ...