To remove an Audit Editor, click "Remove" next to their name in the table.

At this time, you can’t remove Auditee Certifying Officials.