Anthony Scaramucci's father was a unionized crane operator with an hourly wage