I didn't have any sticky tape to hold the new battery in place, so I only removed the outside adhesive tab and left the inner one. This way I would 'lever' the battery out and the innermost tape-strip stayed in place, which was helpful to see the new battery in place. carefull though, you have to lever the battery out very slowly, very very slowly ... but it does work.
I agree with Andrew, this step is not needed.
I found a bit tricky to refasten the little clip. I found it easier to fasten it right-side-first.