If they're not allow to transition at taxpayer expense, it could be a violation of the Eighth Amendment.
How about this: just because you're a man who thinks he's a woman, doesn't make you a woman.
That should be common sense, but it's not. Thoughts and feelings don't make you what you are. Thoughts and feelings can change.
Related: Sex Change Regret.