I'd stay away from chest rigs then. All that weight up high kills my back, I've been looking at different ways to carry gear.
My latest setup seems to be tailor made for what you're talking about
https://www.sordusa.com/product.php?productid=223&cat=0&page=0&featured=Y
The smock is the most comfortable way to carry just the essentials. Mine has water, ammo, food, a Bivi sack, fire starter, nav gear and a few other odds and ends. No pack, no chest rig, no belt....it's pretty damn nice. Spray a bit of waterproofing on there and you're good to go. There is no insulation, it's just a shell, but it breathes better than goretex and wears better. I customized mine a bit for work but its easy to do. The SORD pants are awesome too.
If you have to use an LBE, try the blue force belt-minus
Blue Force Gear
Very light, put your big pouches on there and walk all day. When it's hot, I'd probably try this over the smock.
Chest rigs work best if you're doing vehicle work, but walking....I'd find something that distributes the weight better.
As far as a get home bag? What you put in it is up to you but what I've found is traditional backpacks kinda suck. I was always taking them out because they got in the way. I found the SO Tech go bags work pretty well and shove under seats easily.
Special Operations Technologies
They come in a few sizes and some even can take a broken down M4 if that's your thing.