The battery is a rectangular unit with electrical information printed on one side. It is located on the back of the Game Boy Advance SP.
Use a standard Phillips #00 screwdriver to loosen the 4mm screw that keeps the battery cover attached to the device.
Lift the battery cover up and remove it from the device.
Use your fingers or a plastic opening tool to remove the battery from the device.