Hi, thanks for the hint!
I finally got it working. The trick is to set the GPIO, as you suggested, to GPIO_MODE_INPUT_OUTPUT.
But I also had to setup the GPIO matrix again for the LEDC functionality which was probably lost when LEDC was first configured on the GPIO, but then PCNT was configured on ...