Power Problems With AGS 101

Gameboy advanced power problems, doesn't matter if battery is plugged in or not it will turn orange then shuts off after a second, and it can turn on for a second then shuts off if I turn it off then on and unplug it then plug it back in, I think its the battery but I have no idea any help would be appreciated, thanks.