Using a wide pry tool, like this trim removal tool, go around the edge of the panel between it and the metal part of the door. You will find it held in place by plastic clips. Gently pry each clip out all the way around.
On an older car like the W123, there will likely be some broken clips. Some times, panels are being held in place by only two or three clips.