bad sound when using wired with power off

As the title says, when I use my headphones with the power off I get a distorted sound. Currently watching a youtube video. The background music is audible but not right and the persons voice is not Audible unless the play button held but when i let go, it goes back to not working. My device only allows for wired headphones as well. I can turn them and then hear the voice but it's still not right if the play button isn't held.