Feryl the giant on the wrong side?

Hello I went out of bream Island with the giant but came back with the teleporter. Now I'm stuck because the giant is on the other side and I didn't mark the place ! I tried underground but can't find a way out... Is it a bug or I missed something.?