Replaced battery, doesn't turn on

Before I replaced my battery the iPod would play music when plugged in and for a short time not plugged in before saying low battery and shut off. I got a new battery and replaced it, followed instructions exactly and now it won't turn on or anything. What could have gone wrong?