HD 580 Precision are a special headphone worth preserving.
You might want to try swapping in new magnetic coils with diaphragms (lollipop section) if the toothpick/spring fix doesn’t work.
You can buy the capsules/drivers with coils here, among other parts.