Sunpu Castle makes most sense as a short historic site while you are already near Aoi-ku. A quick visit may be enough for casual travelers.