At least four to five women, including a former staffer who accused him of rape, have made sexual misconduct or assault allegations against Eric Swalwell