Faster person change in the People column when restricted to 1 person

Hi when I have Owner column that is restricted to 1 person It is super annoying that i need to first click to remove a person, and then pick another. I can’t pick someone else to change Owner. It would be great if i could do that.

Example:


In this case i need to remove “Kuba” first and then click to pick “Konrad”. I’d rather click on “Konrad” to change owner to “Konrad” without need of removing “kuba”