GO:1900037:   regulation of cellular response to hypoxia
Any process that modulates the frequency, rate or extent of cellular response to hypoxia.