Greydwarves and Draugr were the same people once
According to the runestones, Greydwarves are made from the souls of murderers and criminals by the Elder, while the draugr are the shambling remains of a once-proud civilization. If the Greydwarves were the criminals of the draugr's society, it explains why they still try to kill each other on sight.
