"We'd gather up old lumber and siding"