Data Migration Expert Forum

Data migration - what software and techniques to gain knowledge of legacy and target data sources?

Dylan Jones (Founder) — Wed, 03 Oct 2012 04:55:21 +0000

"Greetings!

How much do the data migration analysts have to learn about the legacy and new data stores? Is it enough to have a conceptual idea of information items in the data stores? ie. Is it enough to know that the legacy data store has ""clients, invoices, quotations, unpaid invoices"" etc?
Or, do the data migration analysts need an in detail knowledge (like the developers who developed these systems) of how the legacy and new data store function?
Do the data migration analysts gain in detail knowledge about legacy data stores and new data stores, and using that knowledge do they prepare the data transformation mapping document?
In case the new data store is a COTS product, what options do the data migration analysts have to gain knowledge in the new data store and produce data transformation mapping document?
Thanks"

What ETL or data migration tool can map and migrate lots of tables in Oracle?

Dylan Jones (Founder) — Wed, 03 Oct 2012 04:44:33 +0000

I would like to migrate the datas to a different database structure (from Oracle to Oracle but different schemas).

The problem is that there are lot of tables (42), and I have not found any tools that help me to map this amount of data being a job inside an ETL process.

How can we estimate the effort for a data migration project?

Dylan Jones (Founder) — Wed, 03 Oct 2012 04:39:48 +0000

Dear All, I had recently started managing migration projects.

Can someone please let me know if there is any format/ template to estimate the efforts for a data migration project. For example a 50 GB database with data cleaning activity might take 1 man year to migrate the data from oracle 8i to 11g.

So if some one can provide activity based measurable item it would be helpful to me.

Even if you provide a link to a article or a book to purchase, it is fine with me

Thanks in advance

Haphazard data migration - tips for turning project around?

Dylan Jones (Founder) — Wed, 03 Oct 2012 04:23:41 +0000

I have been brought on to a data migration project in the late stages.

I have found that a consulting company has attempted to migrate the data, but it was done haphazardly, without documentation, methodlogy, or structure of any kind. They basically were trying to muscle the data in, even going so far as to manually edit data in the target database that wasn't migrated successfully.

My job is now to take over the migration and bring structure and documentation to the project. Oh, did I mention we have a tight deadline. The only saving grace here is that the source of the data is in a good relational database (which is very similar in structure to the source database), so data cleansing is pretty much nil. The only transformation that needs to take place are some data that is not exactly analogous in the target database to the source database.

My question is, at this stage of the game, what methodology, procedures, etc. can I create and follow to bring this to a successful finish?

How should we perform data modelling and data mapping on our pensions data migration?

Dylan Jones (Founder) — Wed, 03 Oct 2012 03:56:37 +0000

Hello there, and congratulations on a very useful and informative website.

First of all, I must confess to being a relative newcomer to data migrations in comparison to the experts on this panel - so please do bear with me!

My question really is around data modelling and how in best practice this fits into the migration process around mapping, validation/cleanse and reconciliation.

But beforehand, a little bit of background...

How should we perform data migration testing?

Dylan Jones (Founder) — Tue, 07 Aug 2012 04:15:00 +0000

I am new to the profession but already I've learned that this is an area we need to improve upon.

What techniques and tools do people recommend for improving data migration testing?

What tools can help unstructured-to-structured data migration?

Dylan Jones (Founder) — Wed, 18 Jul 2012 05:04:00 +0000

Hi
The company that I work for is thinking of migrating a vast amount of unstructured data into a new structured database. Our current thinking is that we will need to do the data quality and cleansing by having a person looking at each record and extracting the relevant and correct data. This seems very time consuming and error prone but we don’t see any other way.

My question is: Are there any DQ tools out there, which is very good at understanding the complexities of unstructured-to-structured transformation.

Kind regards

Sample Data Migration Project Plan or Roles and Responsibilities List?

Dylan Jones (Founder) — Wed, 18 Jul 2012 05:00:00 +0000

Can anyone provide a list of the typical roles & responsibilities are for a DM project? Or a sample Project Plan? Thanks

What form do you think the archive of the legacy system database should take?

Dylan Jones (Founder) — Fri, 15 Jun 2012 04:00:00 +0000

What form do you think the archive of the legacy system database should take?

It is often suggested it should only store the data that is not migrated, but my view is that it should be the complete copy of the legacy database with some audit tables and non business data tables excluded.

The problem I have with the former is that it is difficult to work out what was in the legacy system as you have a partial copy in the archive and transformed data for the rest in the new system. You may never be able to work out what was in the legacy system. This could be a major problem.

The latter gives you a full dump of the data and then only requires that some reporting interface and reports are created to be able to understand precisely what was in the legacy system.

What are your views?

Data Migration in Retail Banking - What resources do you recommend?

Dylan Jones (Founder) — Tue, 05 Jun 2012 04:37:00 +0000

Can you please let me know any inputs/docs/links/papers/books migration strategy/testing strategy for data migration for retail banking