I could not find a reference how to remove a remote branch that is connected to an SVN repository so I have tried this:

$git branch -r -d my-remote-branch

This seemed to work well.