وإنما تفرق صدقة كل قوم فيهم
Translation: The zakat of each community is ordinarily distributed among its own people.
The manual makes local distribution the normal pattern. Local conditions and the needs of known eligible recipients are relevant.
This does not make an otherwise eligible outsider permanently ineligible: the next clause makes explicit exceptions.