One of my best friends is going through a messy divorce and custody battle.?

And because I called her soon to be ex-husband an ****** to a so called mutual friend, turned around and told him that I said it. Now he says he is taking me to court for slander and talking about him plus he told his soon to be ex-wife that if he found out that she had their 2 year old daughter around me, he would take her to Social Services and make sure she didn't get her. I've heard and I've seen the mental abuse he has caused this woman and to me this is another threat and blackmail to get what he wants. I've watched this little girl since she was born off and on when they wanted to do something and I've never said anything in front of her, even though she just turned two. Do I need to be concerned about being dragged into court for this?