Stop him when he raise his voice over you for the first time. Don't await to raise his hand.
You set limits,no one else does. The other person only can do with you,what you allow them to do.You always have a choice to stop it when he starts.
I repeat,every single time.