It's not just the "possibility" that is destroyed.
I think that mental circumlocution is part of the problem.
A fetus is a human being. When you miscarry, you don't just lose potential. You lose what is. And until we come to that understanding, we'll always be uneasy about miscarriage.
The thing is, if we come to understand the fetus to be anything more than potential, it begins the slippery slope down to recognizing him as a human being.