Exterior Siding Installation Time

I'm starting to build up my walls before I install them onto the floor. They are made from a 3/4" core with rigid foam insulation filling the open spaces. The inner walls will be 1/4" plywood and the outer walls will be 1/4" plywood and sheet aluminum.
My question is: Should I completely build up my walls with all the siding before I install them or wait on the aluminum siding?
If I wait to install the aluminum siding I can screw some screws into the frame to add strength holding the body on. It would be more difficult to glue unless I used a contact adhesive.
If I install the aluminum siding first the pocket hole screws inside the the lower inner walls should be enough to hold the body on tight.
I'm just not sure what would be the best and the easiest.
As always, thanks for any comments.
My question is: Should I completely build up my walls with all the siding before I install them or wait on the aluminum siding?
If I wait to install the aluminum siding I can screw some screws into the frame to add strength holding the body on. It would be more difficult to glue unless I used a contact adhesive.
If I install the aluminum siding first the pocket hole screws inside the the lower inner walls should be enough to hold the body on tight.
I'm just not sure what would be the best and the easiest.
As always, thanks for any comments.