Possible to re-assign person in People column with one-click?

I want to be able to re-assign the person in a People column in a single click in the dropdown menu.

Right now, if the People column isn’t restricted, selecting another person from the dropdown will just add them as an additional assignee. And if the column is restricted to just 1 person, selecting another person from the dropdown throws an error message that “the column is limited to one person.”

In order to reassign, I have to click to remove the currently assigned person, and then click again to select a new person