Two things:
- Spring for at least a blower-door test. Or go ahead and apply for EnergyStar rating and this test will be run. ~$300 up here, and greatly adds to the value to be certified. The blower-door test will tell you if you have air leaks; sounds like you do. Air changes had better be less than .5/hour in the test. Spring for
FLIR imaging to spot your culprits. Have this done on a night when it's cold outside.
- Window design is critical. It must be double-paned (which I'm sure you have), it must be carefully foam-sealed around all windows, and one side of one of each of the panes must have a nickel coating. This nickel coating must face where you want the heat reflected. In cold weather, to the inside; in hot, to the outside. The Germans are now making a window that actually has a reversible nickel-plated pane!