No Nick swimmers are not boats. Kiteboards are though. My mate can swim out to his sailboat anchored off the beach in front of his house in NSW but if he takes his tender he needs a lifejacket.
It's a first world problem. Too many bureaucrats, too many lawyers, trying to justify their existence. The 3rd world has none of these problems of rules and regs..
