Data integration is a fact of life for those of us who are in the information technology business. Since we are yet to invent a single system that does everything for everyone in an enterprise, it is inevitable that we have to support and deal with multiple systems. It is equally true that unless the data from these diverse systems are integrated, we will not be able to understand the data in a coherent fashion. With the proliferation of “best of breed” solutions we have a complicated mess in hand.

Most institutions have a large administrative system like Banner or PeopleSoft that is considered to hold the authoritative data. In addition, for the purpose of reporting, we all have a data warehouse or a data mart into which data from the central systems is inserted typically on a nightly basis. The general premise of this is that the administrative systems were originally designed to take in the transactional data and therefore optimized for that purpose. They were not designed for complex reporting. Combining both of these in one system means a drain in resources and everyone suffers. Modern systems like Workday claims to have designed their system in ways that you can do all activities in one system. When you have multiple systems, generally, the data is integrated with the administrative systems, though in some cases, directly into the data warehouse.

(more…)