Gerroa is very sailable in a strong Westerly if you'd rather a few waves plus has the added safety of a headland preventing you heading to NZ. Port Kembla another option but not done it myself yet.
Westerlies anywhere around here are generally pretty gusty unfortunately but at least you get wet.
Usually only 1 or 2 of us out in the waves as it seems most are spoilt by the summers and don't like gusty conditions/opposite tack.
If the wind goes SW rather than WSW it stops blowing to the South of Saddleback mountain. Lots of little local effects to take into consideration but if you have any questions drop me a message as I'm usually grateful for someone to sail with over winter. In Summer you can stay at Wanda though