Prince Sorovets Cave

I walked down a path and some rocks fell down behind me. I found a key called cave key at the end of the path. Now I can't get out. Any advice?

There's a white switch over the hole in the north.

It's actually not shown, you have to just shoot at the wall, but thanks for the help though.