Joseph Schwartz was sentenced to three years in prison for federal tax crimes