Starboard tack has right of way.
If you have your right hand forward, you are on starboard tack, this means you have right of way - and will normally pass on the upwind side...
You are not alone in not understanding this basic right of way rule. Many other kiters just don't get it

You are best being cautious and courteous... give way to everyone... particularly pugs