Stormtroopers are clones of either Bruce Wayne, Conan the Barbarian, Crossbones, or other peak humans. (Any combination of the peak humans) Each Jedi/Sith is alone and both sides have no prep in a large building. Stormtroopers have just blasters, a few grenades, and a knife. How many to get the job done?
I would exclude people like Cap because he would be a wimp without his serum, BP without his herb, and others of that nature.