An argument from conceded premises may still fail because its form is invalid.

Dialectical Syllogism: Commonly Accepted and Conceded Premises