The Z button is located above the right trigger but functions as a button.
Place the controller (buttons down) on a solid surface.
Remove the six 9.2mm Tri-wing Y0 screws that hold the back panel in place.
Gently lift the back panel up, separating it from the front panel.
Grab the Z-button by the peg with tweezers and lift it out of the controller.