"Our grandfather would always say, 'You don't realize what the halcyon days will be like until you can look back on them,'" he said on the 'Brotherly Love Podcast' ...