"Well, I mean, the President can play golf with whoever he likes."