Is there any problem to not use any glue at the sides?

As, there is some discussion about to float or glue the top skin but nothing about the sides.
I’m thinking the door trim the porch light the side lights, the water filler device and the corner molding around the whole shape will hold the aluminum skin in place.
Raul