GO:1903054: negative regulation of extracellular matrix organization
Any process that stops, prevents or reduces the frequency, rate or extent of extracellular matrix organization.