Different jobs require different skills, logistics are just as important as the grunts and provides a place for the folks who for whatever reason are not in there peak condition. Unfit people in a fighting unit are a liability and put everyone at risk. As for not drawing unwanted attention but wanting to condition yourself, most stores with a sporting goods department sell weighted vest... Or you could pull a sweatshirt over your plate carrier. Also with the rise in popularity of events like goruck you would not look unusual Hiking down the road with a weighted pack.... just my 2 cents.
Skillet nailed it lol. No problem FuhrCQB.