Sliding issues, left joystick not sticky

So I bought a wireless xbox controller maybe 4 months ago. The joystick and buttons all work perfectly. But just yesterday I was playing some games and noticed that I would make myself go forward with the left joystick and every so often it would keep me moving for a few seconds.

My joystick isnt sticky and returns to the correct place every time. It literally just came out of nowhere yesterday. Also it only happens in the games. I can move it around the Xbox home page or go to Edge and do stuff without the sliding issue. It's only in games