It's because, in short, people, especially short ones, get shirty about shirts and shorts, so that if one were to swap shorts and shirts, shortly shirty short short-wearers (some wearing short shorts and some indeed wearing shirts with their shorts, some of which may be short shirts) would surely shorten the tenure of the shirt whose short career had led to the short-shirt debacle.
What sort of business do cows do, mostly?