United States Representative Eric Swalwell retained his seat in Congress and his position on the House Intelligence Committee after severing ties with Fang Fang