The pin is of the tapered variety, my experience with those is get it right first time, carefully decide which way it has to go, select a nice fitting drift and a heavy hammer, once.
The chuck is held on a tapered stub, (a jacobs taper?), no other fastening other than the self locking effect of...