Congrats.

How young are we talking? What sort of boat?
I didn't take my son on board until he was able to unassisted float the right way up in a life vest. They of course have huge heads which makes them prone to face down even in an approved vest.
I would get that sorted and then look at a cheap small tinny.
We used to tie up along side and my wife went aboard first and I remained seated and passed him up. Exiting I would get seated in the tinny and get alongside and she would pass him down. We didn't have a drama and now he hassles me constantly to go out boating with him. He does have a habit of falling asleep when we start sailing.