"But the worst of it is that it's been so hard for him to have me along."