Xbox one X performance issues

Hey there. My xbox network test shows ok results. 40ms latency and ok dl/upload. Connected ovet wifi.
The problem is following: I have constant banding/lag like symptoms when playing. It's very annoying and keeps happening every 3-10 second. It's not FPS drop, at least I think so.
Am I alone with this problem or are other players having similar issues too? I haven't found a fix so far.

Stop using WIFI