Pillars of Eternity - toggling is messed up

There are some games, like Pillars of Eternity, where ReShade toggling is messed up. I can press SCROLL LOCK 20 times and it will properly work/toggle only once or twice, even if I wait 10-15 seconds between toggles.

Any ideas why and how to fix it?

70-120fps @ 120Hz. The game also toggles effects off and on when Options Menu is entered and exited.