For a glimpse of the past around Baku, consider Nasimi Monument, a historic memorial. The stop works better when you are already in the area.