The battery compartment is located on the bottom of the camera on the right side. Replacing the battery should be a breeze.
On the underside of the camera, there will be a small door that you can open by pushing out.
Having done this, the battery door should pop itself up and allow you to slide in a new battery.
From here, simply insert a new CR123A Lithium battery.