Campaign management data migration - need advice
Friday, June 27 I'm working for a client that is implementing a campaign management and
analytics solution.
We're currently designing the solution architecture
and conceptual data models for the solution. One of the requirements for the
solution is that there is a minimum of 15 months worth of data within the data
marts for analysis purposes.
There will be approx 15 data sources for the
solution. Some of the data sources only keep their data online for 3 days before
it is archived off to tape stored in an underground bunker somewhere!
I
need to work on a migration strategy to perform an initial data load and
verification of that data load.
Do you have any pointers on where I
should start, activities testing approach and what governance can be applied to
ensure success?
Reader Comments (1)
If they require 15 months of data at the time of implementation, you will obviously need to make it clear to them that you need access to the data in the "vault" as soon as possible. Campaign data can often incorporate sensetive information (personal and financial), so you may encounter some resistance in that regard. It will be critical to acknowledge that and provide specifics on how you intend to safeguard their information during the migration process (transmission, storage, manipulation, encryption, ...).
You should be working with a fairly limited data set, so I would not anticipate too much complexity with regard to the 15 data sources providing this is a one-time migration. If you will need to interface with some of these systems moving forward, it becomes a different question.
You will need to start by performing analysis on as much of the data as they can provide ("real" data more often reflects reality than system documentation), and setting up a clear channel of communication with the stewards of the various data sets. They need to be available to you to answer questions or clarify issues, and you should keep them informed on challenges you encounter, progress (or lack thereof) you're making, and issues you perceive. The surest way to be successful is to keep them engaged.