The next time he starts shit talking you stand about 3 feet from him and ask him if he's man enough to back any of it up. Don't smile, or smirk, or frown. Just hold a neutral expression. Then you can proceed to tell him about all of his short comings. If he's a bitch he'll stand there like one. If he has any pride he will make a move, and you can use "the reasonable and necessary force necessary to defend yourself from a violent attack".
"Feminism is a trade union for ugly women"- Peregrine