Took the caps off as a matter of course, lol, then had to go find them but they still wont' fit properly to my mind with or without them. The rubber is far too narrow/long to push on when it's flopping about, must be my technique. :-)
Just for a test I cut off all the rubber to about 1/2 inch from the metal of the connector and it was still a struggle to fit.