The former vice presidential candidate's family left after Track Palin allegedly attacked another party guest.