The balloon moves downward. Towards the person’s feet. Or, more precisely, AWAY FROM the denser, heavier air which will be forced to the top of the elevator by inertia.