Before the limestone towers of Fifth and Park Avenues completed their social ascendence, the mansion was the only acceptable way for the extravagantly wealthy to live in the city.