Ah, I think I understand where my description is falling short now

.
First, hinten, you are correct on all counts. Have at it ... you'll be fine
Second, "Door Panel" includes everything. The whole piece of trim.(substrate, armrests, bolster, swich plate ... everything).
JCJ, your mistake is that you are pulling on the middle of the panel. DO NOT DO THAT! You are correcet, you will probably break it. You need to remove the panel from around the edges ... the only fasteners in the middle of the panel are the screws. I would suggest starting at the upper rearward corner of the panel since it is the easiest place. After you remove the screws, simply put your fingers behind the black plastic strip on the top of the door and pull it straight away from the sheet metal ... it shouldn't take much effort. Then work your way around the outside edge of the panel, releasing each fastener as you go.
One last note ... and you can either do this before you begin to release the fasteners, or after. To be able to completely remove the panel (as opposed to pulling it away from the sheet metat 3 or 4 inches), you will need to pry up on the switchplare (it is just snapped in) and disconnect the harness. Also snap out the courtesy light. The electrical components will keep the trim :tethered" to the vehicle.
Founding member of the "No Hummer Krew"