Also known as Hope's Folly, the strange, square building was out of place beside the pretty, thatched Rose Cottage.