Just two buttons will give you the functionality you need.

With the first button you assign a prefix and select the desired color.

With the second button you can delete the prefix.