Not every و or ي is a long-vowel letter. For madd, the preceding short vowel must match: ḍammah before a silent waw, and kasrah before a silent ya. A silent waw or ya after fatḥah is instead called a letter of layn.
خَوْف contains a soft waw.
بَيْت contains a soft ya.
قَالَ contains long alif.
Also, hamzah (ء) is articulated in the deepest region of the throat. It is not the same sound as the long vowel alif merely because the written forms can look related.