Why data quality is deteriorating
I've witnessed the marked decline in data quality over the years (Poor data quality eats into IT budgets). Unfortunately, the guys running IT are now typically IT illiterate – accountancy is more their bag – and don’t appear to know what data is. Mention normalisation and they look blankly at you.
If the management and the business don’t understand data then there will be no budget to put things right. Most of the overnight batch issues are down to corrupt data, such as missing parent/child relationships. Customer analytics is another area beset with data quality problems.
Charles