I missed seeing these two washers on the first joystick reassembly. The ball joint was too tight when I secured the retaining plate, so I loosened it. While working on the second joystick, I noticed the washers and realized they were responsible for assuring enough space for the ball joint to move.