There are two screws behind the inside armrest/handle, and one screw behind the door opening mechanism on the doorcard.
Have you got both the armrest handle, and opening mechanism backing/surround, off?
Remove those screws, then pop off all the clips from along the bottom and up the sides...