Check here for required equipment:
www.rms.nsw.gov.au/maritime/index.htmlIf you want a PLB, there is a shop in Mona Vale that rents them. GPSoz. $5 per day, min 7 days. If going solo, I'd suggest this is a must have.
If you are going to end up overnighting, Quarantine beach (near little manly) has about 4 public moorings and Athol Bay near the zoo has about 7 public moorings. Mid week shouldn't be a problem getting one.
Keep a good watch out ahead and behind for ferries, the river cats come up fast and are not very noisy. Give circular quay a wide berth as it gets very busy in and out with the ferries.
Enjoy!