Why won't my gameboy advance sp wont turn on?

my gameboy does turn on but it only turns on for a second when the charger connects, but is some how it not turning on without the plug, the battery is fully charged but it is not using the battery power. like something make it not give the flow from the battery. anyone pls tell me what is the ploblem.