I've not fished out of there but San Diego is only a short hop south and there are a lot of blue water charters for Tuna & suchlike. Inshore is supposed to be fun down that way too. Lots of fishy looking inlets when I was putzing around over there one week-end a few years ago. Not sure what its like with the new "No Fishing" Marine zones around Santa Catalina?
Take your golf clubs - Torrey Pines to the South, Pebble to the North