Lord Harry Holdsworth

My parents had mentioned to me this plaque (sp?) at the Rocks. It caught their attention because my paternal grandfather's name was Harry Lord Holdsworth. (So we called him Lord Harry..) After seeing this commemoration, we are starting to wonder if there is a family connection to this former Governor of NSW? I am going to start the research one of these days...