That's the reason.I use esp_timer_get_time() function.
You're right.
I found a simple intermediate solution:
using cpu_hal_get_cycle_count() function (paired with _set_) instead of esp_timer_get_time()
Thanks everyone!
UPD: hardware timer also works well