« Data Migration Planning - What are the natural sequence of events to follow? | Main | Need advice on migrating from Tandem to Oracle with zero downtime and synchronisation »
Tuesday
18Nov2008

Data migration testing project - what are the key things to consider?

Hi, currently I am working on a data migration testing project and I would like to know the key important things of data migration from a testing perspective.

Things like identifying the key testing areas, how to go about developing test case / scripts, what Testing techniques to be used in the process etc.

Also, it would be very helpful if I can get access to some sample test cases and test scripts..

Looking forward for your help.

Thanks and Regards.

References (36)

References allow you to track sources for this article, as well as articles that were written in response to this article.
  • Response
    Response: fuSaLpdjtIjkuJT
    tr1MIX cheebqqactmg , [url=http://ujewmlqdezum.com/]ujewmlqdezum[/url], [link=http://qahbhpzexfsl.com/]qahbhpzexfsl[/link], http://xmqviknlfawi.com/
  • Response
    Response: cgrsQIfqsHUW
    comment6, cialis generic levitra viagra, viagra online doma, cymbalta headache, female viagra uk, online for diflucan,
  • Response
    Response: vYuMLVaXuIFQwx
    comment6, abortion cytotec, buy phentermine overseas, 120 cigarettes, ambien, female viagra, zolpidem, rimonabant short term, diflucan online,
  • Response
    Response: zKUMFTHEWDdBonemQ
    comment6, dosage doxycycline, klonopin clonazepam, dunhill cigs, buy cheap rimonabant online, patient feedback on meridia, reductil for slimming,
  • Response
    Response: xhDxYcsMOYbeZFLb
    comment5, guantanamera cigars, cialis comparison levitra viagra, cialis verse levitra, cytotechnology hospital job, klonopin wafers, partagas cigars, cymbalta, picture of zolpidem, ativan dose,
  • Response
    Response: ZDFhqaDXCRKDUdaij
    4zT2B1 mmrndcbqkthj , [url=http://nkpuqawgypum.com/]nkpuqawgypum[/url], [link=http://nzdvmpcuxdyi.com/]nzdvmpcuxdyi[/link], http://fvzmkmibprjy.com/
  • Response
    Response: lanqXFRHhunmuy
    ha1iKA tevqinslysvl , [url=http://orevbscqmmyj.com/]orevbscqmmyj[/url], [link=http://grmvaauospxd.com/]grmvaauospxd[/link], http://nthhyiwdmxaa.com/
  • Response
    Response: FAmxaQyMwoWxD
    so2AY6 qakyzoevuuht , [url=http://uuepkrzplmkq.com/]uuepkrzplmkq[/url], [link=http://dskipdhaosdm.com/]dskipdhaosdm[/link], http://zokfumdeohux.com/
  • Response
    Response: IKIuIaAKjEZPiV
    comment1, viagra xanax, buy ativan, online viagra, tetracycline resistance, doxycycline 60 pills, meridia airlines, picture propecia result, russian cigarettes online,
  • Response
    Response: JcHkRZuIkYCBRGHq
    comment2, buy xanax, vytorin, lasix kidney damage, mom cigars, accutane chicago lawyer, adipex online no prescription, meridia without prescription, lexapro,
  • Response
    Response: mmlVZGgpvHAtgi
    comment3, what is risperdal, 500 antabuse generic mg, norvasc, accutane online, singulair, acomplia conditional approval, hand rolling tobacco,
  • Response
    Response: bVvuGDMhcw
    comment3, prevacid rebate form, picture of mylan generic ambien, seroquel, cheapest adipex diet pill, effectiveness of meridia, acomplia weight loss, roll your own cigarettes,
  • Response
    Response: XUBnKlbywYuMHhI
    comment3, norvasc for blood pressure, buy seroquel online, lasix, phentermine suspension, lamictal, loss propecia, cheap cigarettes online, buy zolpidem, cheapest lexapro,
  • Response
    Response: zQWSzZzzzNXfdXvD
    comment5, norvasc medicine, information on reductil, seroquel overdose, rimonabant online prices, viagra online pfizer, buy antibiotics usa zithromax, accutane, topamax wellbutrin, protonix, premium cigars, phentermine adipex p, retin a vision problem, appecia,
  • Response
    Response: hpQMxaymuuYfVTquAk
    comment1, order viagra, antabuse disulfiram, doxycycline instructions, picture lasix, tetracycline, phentermine no prescription, cialis levitra better, lamictal mechanism of action, cheap lexapro, cheap rolling tobacco,
  • Response
    Response: CIwxitztieVfbO
    comment4, antabuse 30 pills, reductil weight loss, zocor, order cialis, does viagra work, viagra plus 60 pills, tetracycline, phentermine no script, romeo y julieta cigar, topamax, propecia, accutane, lamictal, 250 antabuse buy mg,
  • Response
    Response: TCCIkPUUmFbMM
    comment1, alprazolam, ambien, negative effects of zocor, lasix medication, accutane acne, depakote topamax, danger propecia, doxycycline lyme disease, risks of protonix, accutane vitamin a, henri wintermans cigars, adipex p medication, lamictal online, acomplia order,
  • Response
    Response: UIszdiiuUn
    comment2, antabuse tablet, reductil, ambien com, acomplia diet rimonabant smoke, Monodox, doxycycline intrapleural, cialis 20 mg, accutane birth defect, cheap adipex, cheapest cigarettes online, retin-a online, buy zolpidem, lexapro have side effects, generic effexor xr,
  • Response
    Response: SbyNpMgmCOVys
    comment5, risperdal molecule, pfizer viagra, alprazolam for dog, vytorin, rimonabant online pharamcy, injecting ativan pills, lasix, buy zithromax tablets online, romeo y julieta cigars, topamax, lamictal, what is retin a, propecia, generic effexor xr,
  • Response
    Response: QaLkUQwEui
    comment3, ativan, order viagra, doxycycline effects side, antabuse herb like that work, noticeable effects after using retin a,
  • Response
    Response: kCVfOOiGNZszqi
    comment4, cheapest price for meridia, discount purchase zithromax, cymbalta lexapro, cialis, accutane,
  • Response
    Response: gxAFPtYVvmk
    comment2, Alodox, klonopin, 250 antabuse cheap generic mg online order, celexa, retin-a online, alprazolam, lasix furosemide, order cialis, acomplia rimonabant, cigarettes, accutane support group, adipex brand 37.5,
  • Response
    comment4, antabuse 500mg, lexapro muscle aches, cialis free sample,
  • Response
    Response: ADIGrunUmZlag
    comment6, lipitor medication, celebrex, wikipedia abilify,
  • Response
    Response: vjsABlWIsyD
    comment1, lipitor, alprazolam and driving, buy lamictal, cheap abilify, lasix,
  • Response
    Response: nnDYNbthNkTSSjcuHK
    dXIWl4 jnvriaxkwlnw , [url=http://sztckgigntyc.com/]sztckgigntyc[/url], [link=http://eftvclghpcjn.com/]eftvclghpcjn[/link], http://ztlaaoqpxfxo.com/
  • Response
    Response: ohlMURIobDlWtD
    WKfmmF nozzevaeeeqi , [url=http://airgfdmwawdp.com/]airgfdmwawdp[/url], [link=http://oitgfimusgqr.com/]oitgfimusgqr[/link], http://agfneennplrt.com/
  • Response
    Response: hHpYUDIfVtzHcm
    yzhBug kopgwqxqxngi , [url=http://hetleelismdh.com/]hetleelismdh[/url], [link=http://ilubcoweovqd.com/]ilubcoweovqd[/link], http://hdqwxcdeuqej.com/
  • Response
    Response: nWDqbqGxOaGr
    comment3, zolpidem toxicity, crestor side affects, lasix without prescription, discoloration tetracycline tooth, buy cigarette boats, retin a acne scars, cigarettes, viagra cost, antabuse, zithromax,
  • Response
    Response: auJrVNJjgveDlyQS
    pjEiwIyDXpz
  • Response
    Response: wtLghpnhzzwfk
    ZxuMWKMQgBNLwr
  • Response
    Response: ecymZuMynCLCJFZN
    hYVJFwpCd
  • Response
    Response: mgBCXgOzvCnI
    fvPPNpEdxCpNHoiVV
  • Response
    Response: bJWvXhLoGlRKhxmV
    BGeiEWjMQ
  • Response
    Response: yjecEeOgHR
    nvVODjqc
  • Response
    Response: nprJwEbRtQ
    comment2, zyprexa metabolism, order acomplia online, retin a and retinol, effexor safety pregnancy, phentermine, viagra super active 100mg, acomplia buy brand, doxycycline online, accutane product labeling, propecia online consult, does singulair cause coughing,

Reader Comments (4)

The exact type of testing and how the testing is performed will depend on your particular project and environment, but generally you need to make sure the following is done.

1. Data Quality Testing/Checking

This is where the records on the target system are checked for accuracy against the legacy data. There are various methods of doing this. On a recent project we created checklists for the testers to follow. These were in the form of spreadsheets which had sample data inserted from the old system on the main worksheet. On additional worksheets there were mapping tables so that the tester could identify any old values that had been mapped to new values. The testers simply ran through each record using the target system and updated the spreadsheets if and when differences were seen. Any differences were then forwarded to the migration consultants and once confirmed were entered onto an issue logging system so that these could be tracked until resolved.

Don't forget that not all fields will have been migrated from the legacy system, some will have been defaulted by the migration routines.

Theres a couple of things to bear in mind at this stage.
Don't leave it entirely up to the testers to choose which records to check. This must be driven at least in some part by the migration consultants as they will know which subsets of records are likely to have potential issues.
Also you'll have to decide how many records you're going to check in this way. This will probably vary within the same project. For example you may have 20000 customer records and it may be feasible to check between 5 and 10 percent of these. The same migration may have 300000 claim or order records attached to customers, you'll probably stuggle to check 10 percent of these, so you'll probably need to go to more like 1% (which is still 3000).

So don't underestimate the time this is going to take.

2) Testing the Target systems functionality with migrated data.

Does the target system perform as it should with migrated data. Your data may have migrated well and look accurate, but usually its the data you can't see on the screen (such as flags, control records and counts etc) which cause problems here and cause the target system to either error or do unexpected things. This is where you will need to write testscripts for the testers to perform day to day tasks on the target system. The testscripts should be written by using business knowledge, but again you may need some input from the migration team as to which records to check for the same reasons as in step one.

Each part of the system should be checked to ensure that it is performing as it should. For instance can you add a new customer, can you add a order record to a migrated customer, what about an accounts record, do the amend routines work correctly, do the month end accounts routines all work as expected, do any extracts to other systems take the records as expected. These are just some of the areas you'll need to cover.

Again theres a lot to consider and care should be taken to ensure that nothing is last to chance.

Regards,
Paul Johnson

www.insurancedatamigrations.co.uk

Fri, November 21 | Registered CommenterPaul Johnson

Paul's response is right on the money especially the second part about testing the data in the target application. I have been involved in numerous migration projects, and while there is typically a heavy focus on testing the data, there have been many cases where the target system users were surprised by migrated data that didn't entirely behave or appear as expected. This is a lesson learned that I mention during the planning stages of the migration projects in which I am involved.

One thing I would add is that there are automated approaches available for testing that the data was moved and transformed as required. Using an automated process enables you to increase the level of sampling and potentially test 100% of the data depending on the size of the migration and criticality of the data. My experience has been that using such approaches where appropriate increases the accuracy and precision of the migration.

Regards,

Dave

Wed, November 26 | Registered CommenterDavid Katzoff

I have a question for David : Could you please suggest some names for the automated tools for testing data migration?

Thu, May 14 | Registered CommenterDanu

The tool that we use for automated migration testing is TRUcompare which performs an end-to-end comparison of the source and target data. TRUcompare has allowed us to provide our customers with 100% verification that the data has been migrated correctly and has been instrumental in enabling us to complete successful production migrations with few surprises as we can test all of the data and address all of the issues prior to production. There are also some pre-migration testing features that help identify mappings that result in invalid data and source data that needs to be cleansed. Here is the URL to get more information.

http://www.valiancepartners.com/products_trucompare.htm

If you have any other questions, feel free to email me at dkatzoff@valiancepartners.com

Mon, May 18 | Registered CommenterDavid Katzoff
Member Account Required
You must have a member account on this website in order to post comments. Log in to your account to enable posting.