GO:1904173: regulation of histone demethylase activity (H3-K4 specific)
Any process that modulates the frequency, rate or extent of histone demethylase activity (H3-K4 specific).