The creation of marine protected areas on the "Atlantic" side has made the question harder to answer.
I have to point out that there is a little pinnacle off Bantry Bay in Sea Point that can produce big hotties. Its covered in red bait so just slice a pod open and see what comes in.
The bar in the Ambassodor hotel used to / makes the world's best Irish coffee so it seems a natural choice.
(The barman comes to your table with a trolley and a burner and caramelises the sugar on the rim of the glass by flambeing a bit of whisky. I hope he is still around.)