GO:0043433:   negative regulation of DNA-binding transcription factor activity
Any process that stops, prevents, or reduces the frequency, rate or extent of the activity of a transcription factor, any factor involved in the initiation or regulation of transcription.