"Not sure yet if my architect is going to run a manual J or not..."
Seriously- if your architect won't run a Manual-J (or hire someone to do that), get a different architect! A greener architect would do one better, and run an energy use simulation tool (at least BeOpt, which is a freebie download tool that's fairly easy to use) for tweaking in some of the parameters.
It doesn't take rocket scientist to project that SW facing windows probably boost the peak cooling loads by more than 50%. Operable exterior shades are probably going to be "worth it"- no need to keep the bay view during periods when you're not there, but it does mean you have to actually operate those shades. Keep the view, but think about it before making it floor-to-ceilng-end-to-end glass. You can't much enjoy the view from inside the solar collector, even with the AC blowing in your face.
Building with a decent amount of interior side thermal mass in the rooms with the SW facing windows is something to consider too, since that can moderate the peaks by quite a bit. Concrete-slab floors, and masonry walls (granite counters, marble staircases & fountains :-) ) all add usable thermal mass for moderating cooling loads. If you can peel back a ton or three on peak loads by trimming windows add adding thermal mass it saves quite a bit on system cost on the geothermal, as well as some on the operational cost. This is the sort of situation where SCIP beats ICF performance with margin, at almost any R-value. The thermal mass of a SCIP is accessible for moderating window-gains, whereas with ICF it's isolated.
For floor insulation in slab on grade construction in US climate zone 2 you don't need much (if anything) for an ICF where the footing is below grade- R4-R6 at the slab edge (or would be useful otherwise. By earth-coupling the slab you gain the mass benefit of the ~70F deep subsoil temperatures:
Heating with radiant floors would require at least ~R4-R8 (1-2" of EPS) under the slab in those zones, but that would reduce the thermal mass benefit during the cooling season. While it's fine to do radiant heating for the second floor, limiting it on the first floor to only those rooms with low summertime solar gain is probably the best compromise. Radiant ceilings can still be used with good effect on those high solar gain rooms.
If you're not already 1001% committed to an ICF solution, you may want to flip through
this guy's blog on eventually building with a SCIP approach in Panama City FL, even though he originally considered ICF was the cat's pajamas for building in hurricane zones.