I went there on a day trip, several years ago. The place is so run down and bleak. It is very atmospheric, you can see so many parts of the gaol and the island that it is on. Parts of it are very creepy... One of the things that struck me was how near it is to San Francisco, before I went there I had no idea that it was so close to the mainland.
Well worth a visit.