Abandoned while pregnant

Since he had disappeared out of my life during my preganancy and had failed to support me emotionally or financially, will this give me leverage in a fight for custody? Can I at least limited his time with the child? He told me that he will request a paternity test and ask for joint custody. I am not worried about the test but I am worried about him obtaining joint custody.