How do I remove just one selfie video from my ceremony without turning them all off?

You would need to reject the selfie video for that specific participant in the Review Participant window.