Adding and removing a contact from a contact group