Door panel re-installation problem

Door panel re-installation problem.

I took my drivers door panel off to install in a new sideview mirror. Now I'm having a problem getting it back on. It feel like something is binding and not allowing the panel to go flush enough to let the screws in the door release lever recess engage. Is there a secret way to tuck mirror connector junctions out of the way to let the panel get closer to the door frame? Or to the have to be in some sort of secret order to let it happen?