having had some experience here....

self rescue is the way to go, i was taught it back when i learnt to sail one designs (80's). have used it 2-3 times since. self rescue was part of the old ayf certificate course.
last time i used it was 40+ knots 1m steep chop, 5pm and getting sharky. i was on a short board and tied/rolled all of the kit up well but was tiring and kept getting knock off the board and loosing bits and pieces into the water.
eventually i ditched the self rescued rig and paddled back to shore. took over an hour.
volunteer marine rescue had been called by a passer by. they took an hour or so to get out on the water and by that time i was walking up a boat ramp with my board under my arm.
i was greeted by the water police and asked if i was ok and what had happened. was handed a beer and offered a lift home by a local.
in this situation you also need to contact the water police and advise them that you have abandoned gear or if someone reports a rig floating they will mount a full air/water search.
then there was the time of mooloolaba,,,,, hmmm, and off the southern tip of bribie when the wind died.................
it's a personal thing but i think you know when it's time to ditch your rig or roll it up and self rescue.