Unplug the smaller connector first. There's a tab on top of the connector that you have to push downwards, then pull the connector. Make sure to grasp the connector itself, and not the wires.
Do the same with the larger connector. Again, there's a tab on top that needs to be pushed downward.