Anyone have a good recommendation for a window unit heat pump? I have a part of my house that has no ductwork (just baseboard electric heat) and I'm looking for something that would generally be cheaper than using baseboard heat to keep the temperature above 50 or so. My plan would be to later install some console units for GEO, and use the window unit for one of the large rooms to provide extra cooling if I had any kind of social event (768 sq. ft room will be good for entertaining when we get it cleaned up).

I believe you are looking for a split airheat unit that goes through the wall not in the window. I believe one with a high SEER Enerstar rating can give more 'heat' than the electricity it burns, almost to the freezing point. At 50' the efficiency is much higher. The ratings of the few units available, that meet the new Enerstar requirements are very close. Installed price, would be an important consideration.

Actually, I'm very much not looking for a split that goes through the wall. In the long run, I'm probably looking at a geothermal console unit for the location. I'm looking something on the cheap side that can be moved eventually.
Basically I have a section of my new house with no ducts, a 768 sq. ft game room, and an office room above that. I'd like to heat the room above with a window unit (wife is set on using it as a bedroom). Later down the road, I'd look at putting in geothermal to both areas as console units to avoid altering them with ductwork. Then I'd like to be able to move the window air pump down to the first floor to act as a window AC so that if I happened to have an event with lots of people, I could run that to boost the amount of AC available.

Did you ever find a window unit heat pump? I am looking for the same sort of thing right now. It would only make since if someone like Sanyo or other makes for the mini splits made a window version with the same technology, getting better SEER and ERR number than a traditional window AC unit?

I am even looking at straight window AC units with a high SEER but can’t seem to find them.

The closest thing that I has seen is a portable AC unit with a heat pump.
http://www.sylvane.com/soleus-air-lx-140.html