In the manga version, when Red Link started to cry over the thought of losing Green and Violet Link. It wasn't because he thought he'd never be whole again. It was because he thought he'd lost someone as near to family as you can get.
The mitigating factor in Shadow'sHeel-Face Turn? Zelda's kindness and understanding.
When the re-fused Link walks away from the Four Sword hand in hand with Zelda, you can see Link's shadow give a thumbs up of it's own accord.