Sulfuric acid from petroleum deposits deep underground aggressively eroded the ancient fossilized reef, built in the Delaware Sea by sponges and algae more than 250 million years ago, leaving behind the gigantic caverns contained within the park. An enormous variety of spectacular stalactites and stalagmites cover the caverns’ floors and ceilings.