“Ballard is making himself out to be this all-powerful Trump lobbyist with unfettered access to the administration, but that’s simply not true,” said one of the four people.