Howard Gould and his wife, actress Katherine Clemmons, created the original estate on Sands Point, purchasing the land in 1900 and 1901. He was the son of ﬁnancier and railroad tycoon Jay Gould. Castle Gould was designed by architect Augustus N. Allen in 1902 to look like Ireland’s Kilkenny Castle and was completed in 1904. This impressive 100,000-square-foot limestone building was intended to be the main residence on the estate, but when Katherine decided that it did not suit her, Howard proceeded to build Hempstead House.
Castle Gould then served as the stable and servants’ quarters and now houses the Visitor Center, Great Hall, and a New York State-certified sound stage.