The same particle does not affect every imperfect form in the same way.
The past tense does not undergo this particular set of ending changes, but the imperfect does. The imperfect forms are therefore first grouped by their endings.
For now, learn the three-group map; each group’s forms share the same kind of ending.