Data sprawl has become a real and costly problem inside organizations, and it’s hurting innovation. According to a new Hakkoda survey, 6% of business and IT leaders labeled their data organization and processes a “dumpster fire.”
For organizations spending millions, or even billions, on data and analytics, data sprawl is the unplanned result of layer after layer of individual initiatives in which data is copied, exported, or sent to various applications. It’s the natural — but costly — byproduct of organizations chasing opportunity. As organizations have seen the power of data analytics, initiatives have soared. Collecting data is easy, but turning data into intelligence is hard, expensive, and not always entirely effortless.
Costs are high across the data analytics lifecycle, with BI and reporting (54%) and data architecture (52%) costing the most. After decades of data initiatives, most companies have an ever-growing tangle of BI apps, data warehouses, and service providers: one in four respondents have more than 10 BI apps, 35% use five or more data warehouses, and nearly a quarter rely on ten or more service providers.
While talent is scarce — 97% reported problems finding data scientists, architects, analysts, and engineers — more than three in four executives surveyed (77%) report large numbers of staffers doing basic reporting and analytics, including a quarter (25%) which reported having more than 500 data analysts in their organization.
Freeing or finding great talent could have a big impact on innovation. The vast majority (94%) of respondents reported some barriers to innovation in their data programs. When asked what is preventing organizations from innovating or creating new offerings with data, the number one answer was insufficient internal expertise. Internal bureaucracy and the inability to tap into existing resources were a close second.
