Ordinary experience does not show a human being making such an extraordinary bodily journey. Yet not occurring in usual experience is not the same as being logically impossible.
A person's inability to lift an object without ordinary equipment shows a limit of human capacity; it does not prove that lifting it by an extraordinary means would be contradictory.
The point in discussing miracles is that Allah can bring about an event beyond customary causes. Its occurrence is known through reliable transmission, whereas the rational argument addresses an objection to its possibility.