GO:1900037: regulation of cellular response to hypoxia
Any process that modulates the frequency, rate or extent of cellular response to hypoxia.