Effects that modify Turtle-Duck's power without setting it will apply no matter when they started to take effect. The same is true for counters that change its power.

Turtle-Duck's ability overwrites all previous effects that set its power to a specific value. Other effects that set its power to a specific value that start to apply after the ability resolves will overwrite that part of the effect.