Orlando Brown House, at Liberty Hall Historic Site at 202 Wilkinson St., was designed by Gideon Shryock for the senator's second son, Orlando, for a total cost of $5,000. Little has changed over the years; the 1835 house has a floor plan similar to that of Liberty Hall. The style of the house reflects the transition from Federal to Greek Revival. Original furniture, silver, china, brass and family portraits are displayed. The historic site is owned by The National Society of the Colonial Dames of America in the Commonwealth of Kentucky.