"We just don't want to burden our little angel"