I solved it by cleaning the contacts, reseating the battery and removing the microSD card. The SD card can then be put back in later

My console has been off and without a battery for months now and I haven't been able to get a replacement battery until very recently, I replaced it just now and the orange led lights on (albeit for a short time) but the console won't turn on. The blue led lights up briefly then goes out again and the console remains off. Could it be something wrong with the console itself rather than the battery? Edit: Should I just leave it plugged in for a while even if the orange led doesn't stay on?