Can anyone give some advice on the best way to remove the Sierra hubs from the rear of a Zero?

I can't workout for the life of me how you're supposed to get to the four nuts on the back of the upright when the driveshaft/CVJ is in the way. I've got the big 41mm nut off and the only way I can think the remove the hub is to remove the whole upright. Unfortunately, having removed the bolts holding this to the wishbone, this doesn't seem to want to come off either. I must be forgetting something...