I have thought about it before, and it makes perfect sense there is no altar in Anachronia as the known gods didn't come to Gielinor in the First Age Anachronia.
My theory is there were/are Dragonkin dieties, and perhaps altars too, but we haven't gotten to Meeting History with 1st Age ancient NPC yet... perhaps Rasial will change it.