If you can buy a 'mansion,' you can pay an affordable housin