Abandoned Building by the Coast

The structure, which appears to have been used as an altar, was constructed in a location where it could not be easily spotted.

It's hard to imagine why anyone would go through the trouble of coming to this altar to worship. There are two steep walls surrounding the altar. You have to pass through a narrow cave in order to reach the altar. Why was the altar abandoned?