In a four-rakah prayer the number of groups stays two, but the imam shares two units with each rather than one.
Imam: 2 + 2 = 4. First group: two with imam plus two later. Second group: two with imam plus two later. Neither group omits an obligatory rakah.