Three family members who have accused a man of sexual assault have denied putting their "heads together" to make "false allegations," a jury has heard.