There was a glorious ancient civilization (perhaps related to the creator of the fragment), but it was destroyed by a major accident called the "Starfall Disaster" (suspected to be related to the disaster), which caused a fault in the civilization, and the stardust magic system was gradually re-established later.
