Housing affordability has been a topic of conversation in recent years. But for some, other things besides cost play a big role in housing access.