A history-focused day in Nassau can include Fort Fincastle, a historic fort. Look around the neighborhood as well as the site itself.