Dhurwah is a summit or elevated point. Bayt literally means a house, yet in genealogical or social contexts may refer to a family and its standing. Rafīʿ denotes height, while muṣammad is something toward which people direct themselves.
A strictly architectural reading would miss the poem’s self-praise. The house becomes a tangible image through which social eminence is expressed, and the assembled tribe provides the public setting in which such a claim is meaningful.