You reach the caves from the other side, so you see the cave name when you are actually already past it.