False Accusations

I am wondering if any one else has had any experience of being falsely accused, being confronted with so call evidence of something they know nothing about and being abused and called menatally defective. I will try to explain a little of what happened to me.My ex narc is married and continued our affair openly in our mutual home town. He told his wife quite early on. Then for some strange reason he claimed to have found things in his pockets whenever he had been with me. My daughter was about 10 years old at the time this started and the 'things' were always small pieces of childrens jewelry or hair bobbles. Of course I belived him at first and did wonder if my daughter was struggling with the relationship and perhaps this was her way of telling us. We discussed this and then he said if it is not her it must be you. I said of course it was not me, why would he think that, how silly and strange and totally out of context. Little did I know he was going to make this an obsession, accusing me or my daughter, he started getting very annoyed and abusicve. Then of course there came the time when he claimed to have found something in this pocket but this time it was while my daughter was away on a school trip so it must be me. We spent so much time, him accusing me, me denying, until ultimately he suggested that I had a mental problem and must be doing it without being aware of it. The problem escalated him becoming violent, threatening, refusing to leave and me having to call the police. We would break up, I would feel terrified,then I would want him back knowing that it was a silly reason to split up and I wanted to get to the bottom of it. I knew deep down something was very wrong. Even if something was happening his way of dealing with it was extreme. Fool that I was i went along with this, consulted my doctor who immediatley said "What are you doing with this person, this is clearly abuse. I must add that at one point i did say to him this is ridicoulous, what possible reason would I have to do anything like this, it is not as if his wife was unaware of the affair. He answer was that I was rubbing her nose in it by leaving my mark on him. The problem continued and of course became more intense. There is a lot more to my story> ultimately all I can think is that he was probably producing these things at home to upset the wife and at mine to upset me, making him the centre of attention at all times. Thanks for reading this i await any advice you may have of any shared experience.