The plastic actuator at the end of the shaft is only held on by pressure, so it can be carefully pulled off. Just be careful not to damage it.
But to get the whole shaft out, there is a c-clip inside the stick. After you get the actuator off, you can take the bottom cover of the stick off (via the four screws), and you'll see the c-clip inside, which holds the shaft in.