GO:0051147:   regulation of muscle cell differentiation
Any process that modulates the frequency, rate or extent of muscle cell differentiation.