Upstream means towards the source of the river (from where the flow originates)
Downstream means towards where the flow ends, at the opposite end of the waterway from the source.
If you are boating from Kingston to Toronto, for example, you are heading upstream. If you are going from Kingston to Cornwall, you are travelling downstream.
Red buoy on your starboard side (right side)
Green buoy on your port side (left side)