I'm not sure where you are getting 179k from. That is so last century. (I'm trying to be funny). The construction of a house involves so many "parts" and subcontractors. Picture each one of these parts costing more through natural inflation (Cokes use to cost 15 cents, back in the day) and it just adds up. Picture the costs of material always going up because of demand. Picture workman's comp insurance at around 40% for every workman out there. Picture regulations that require hurricane proof building procedures and impact resistant windows and doors.
That being said, possibly the best way to insure you are getting the best deal you can, is actually a cost-plus contract, in which the builder gives you copies of all costs of material and subcontractors he incurs, and you agree on a set contractor's fee that you negotiate in advance. If a builder bids a fixed amount on a house, he will have to include a contingency fee, sometimes called "padding" in case things go wrong, which almost always happens. If he estimates too tight, he runs the chance of going out of business. Back in the day, I bid a house, and Hurricane Hugo hit Charleston, and the price of 1/2" plywood tripled overnight. Ouch!