Data Migration Effort Estimation: Practical Techniques from Richard Trapp of Northfield Consulting Group

How do you cope with the uncertainty around data quality on data migration projects, particularly with budgeting and forecasting effort?

Please note, this post was first featured on our sister site Data Quality Pro in : How do you estimate impact of poor data quality on a data migration project?

In an excellent discussion on the IAIDQ LinkedIn forum Richard Trapp attempted to answer this very question posed by John Platten, long time expert panelist on Data Quality Pro and Data Migration Pro.

John Platten of Vivamex opened out the discussion for opinions from others on...

...what to do if you take on a migration lead role and it becomes clear after the contract is signed that the data is too poor, the budget too small...and you realise that the outcome is going to be compromised...

To which Richard Trapp responded:

John, I overcome the hurdle you mention by employing a very comprehensive parametric estimating model. All scope assumptions are clearly presented and approved prior to work starting. When/if assumptions turn out to not be true (number of objects, complexity, environmental constraints, etc.), the impacts to progress are documented and communicated (Earned Value Analysis) and decisions presented to the client to either reduce scope to meet current budget, or to add budget to meet the change in scope.

Intrigued, I asked Richard to expand and he kindly answered several questions that clarified his earlier comments with a detailed explanation.

Click to read more ...

Data Migration Matters 4: Call for Papers

It's that time of year again. This excellent DMM4 conference event by author (and expert panelist) John Morris will be held at The BCS, London WC2E 7HA on Thursday 26th May 2010.

It is the only conference of its kind in the UK and is the fourth in the very successful Data Migration Matters series.

DMM4 brings together the leading authorities in the data migration field including industry analysts, experienced practitioners and senior managers, an incredible pool of expertise brought together for one day to help delegates learn new techniques, share past experiences and connect socially.

A call for papers from Data Migration Pro readers is now in effect.

If you would like to submit your proposal please follow this link:

Data Migration Matters 4: Call for papers

About the Event

For details about the event itself please visit the event website:

http://datamigrationmatters.co.uk/

4 Tips for Becoming a Better Data Migration Client

It’s all too easy to blame your data migration solution provider when your project hits the rails but are you really doing everything on your side of the fence to ensure project success?

Use these tips as a starting point for determining what your company should be doing to ensure project success for all concerned with the implementation

Click to read more ...

How to Implement an Effective Data Migration Testing Strategy

Creating an effective data migration testing strategy is critical to reducing risk and delivering a successful migration.

In this article, David Katzoff, Managing Director of Valiance Partners, a specialist data migration technology and service provider, outlines a blueprint for designing an effective data migration testing strategy.

David rounds off the article with a useful checklist of recommendations that the reader can use to benchmark their own approach.

TIP: Data Quality plays a pivotal role to data migration testing so be sure to check out Data Quality Pro, our sister site with the largest collection of hands-on tutorials, data quality guides and expert support for Data Quality on the internet.   

Click to read more ...

TM Forum Launches Data Migration Survey

Data Migration Pro is launching a programme to understand how enterprises in different vertical markets are tackling the real challenges of Data Migration. 

To kick this off, we are examining the Communications and Media sector, as represented by the global TM Forum organization’s Data Migration Community.  

The TM Forum data migration community is led by Tony Sceales (also a member of our expert panel), Celona’s CTO and other senior industry figures, the group is in the process of building out an understanding of Best Practice in Data Migration. 

The first step in this process is to survey the TM Forum’s 45,000 members to understand their perspective on what the key issues and drivers for success are, as well as to ask about their experience and capability in Data Migration.

Your views are also extremely valuable, and any Data Migration Pro member can also complete the survey at http://www.tmforum.org/Source/550/home.html.

You will contribute to a crucially important study for our profession.

Please also feel free to join the TM Forum Community and contribute your thoughts and experiences.

Webinar: How to prevent your data migration spiralling out of control

This Wednesday 26th August at 1pm (British Summer Time, 12:00pm GMT), Data Migration Pro will host a webinar with John Morris, author of Practical Data Migration.

Attendees will learn practical techniques to help prevent their project heading for failure or delay.

The approximate running time of the webinar will be 30-45 minutes and if attendees use a VoiP headset then the webinar is completely free. There are local toll numbers available for thos who are dialing in.

To register for the webinar please click the following link:

https://www2.gotomeeting.com/register/916140523

Please note that we will be publishing the webinar in this post after the presentation has completed.

Best Practices for Content Data Migration : Interview with David Katzoff from Valiance Partners

Data migration is not solely the domain of database-to-database data transition, it can often involve complex content migrations of documents and unstructured data.

But how do these migrations differ to the more conventional relational database style data migrations? What is the right strategy? What techniques are involved? What are the pitfalls?

We recently caught up with one of our members, David Katzoff, Managing Director of Valiance Partners,  a specialist data migration technology and service provider operating in this space. Dave has kindly answered a few burning questions on this topic.

Click to read more ...

Some recent data migration lessons

Recently, I've been consulting with a mid-sized organisation who are embarking on an initiative to implement a new inventory system.

With just a few days in there have been some serious lessons learned by the organisation on how to approach data migration in the right way.

Click to read more ...

Data Migration Matters2 - Call For Papers

The Data Migration Matters organisers have announced an all day data migration event for the 1st October 2009 in London.

Details will shortly follow of how to attend the event but DMM2 is inviting IT professionals or senior managers with experience of Data Migration to submit a paper for presentation at Data Migration Matters 2.

The selected paper will be presented at the event by the author.

This year there is a special interest in case studies and lessons learned but all topics will be considered.

If you want to find out more details on how to submit your proposed presentation please follow this link:

http://www.datamigrationpro.com/dmm2

How to rescue a failing data migration project [Part 2 - Plan and Mop-up]

Last week John Morris posted a detailed account of how to rescue a sinking data migration project, that post provided some excellent stablising techniques John has developed over many years.

This week John closes out the series with a look at how we can re-plan a failing project and successfully "mop-up" on those outstanding tasks that are so important but often neglected.

Click to read more ...

How to rescue a failing data migration project [Part 1 - Stabilise]

Many members contact us with tales of data migration failure and one only needs to look in the computing press to read the high profile data migration disasters that litter our industry.

We recently contacted John Morris, managing director of iergo and author of Practical Data Migration, for some advice on how our readers can help put their data migration project back on track if it starting to slip off the rails.

John kindly wrote the following series of articles, providing a range of detailed tips and techniques to help you rescue your sinking project.

Click to read more ...

6 tips for "selling" a best-practice data migration

If your most recent data migration has failed or suffered major delays then chances are it was lacking a best-practice approach.

There are still countless tales from members and visitors to Data Migration Pro of projects being delivered with issues such as poorly conceived methodologies, a lack of data quality management, impossible deadlines and poorly skilled resources.

So how do we turn things around and convince sponsors and stakeholders to invest in a best-practice data migration?

Click to read more ...

Promoting DQ Tools for Data Migration Projects

One of our members recently had a tough time convincing her peers and sponsors of the need for a DQ tool on their forthcoming data migration project.

She had been pitching the benefits primarily of cleanse, citing the fact their migration tool had limited DQ capabilities so an additional toolset to manage the more complex transformations was required.

The source systems were largely consumer addresses, their business being B2C in the financial sector. The argument she came up against was that they already had a profiling tool so why couldn't that help solve the problem?

Here are some of the additional areas that DQ tools can help increase the success rate of any data migration project.

Click to read more ...

The data migration go-live strategy - what is it and why does it matter?

In this post we take a look at some of the different combination of data migration go-live strategies and what they mean from a technical and business perspective.

The landscape of data migration implementation options has changed in recent years so we thought a brief introduction to the different approaches would benefit our business and non-technical readers in particular.

Please note, Data Quality is a critical element of any data migration project so be sure to check out these Data Quality Strategy articles on our sister site - Data Quality Pro.

Click to read more ...

How to create a data quality rules management repository (Part 2 - Creating the application)

This post is the second in a series that explains how to create a data quality rules repository using a simple web app for building the functionality.

The following video will illustrate how to create an online application to store, query and share your data quality rules across disparate teams and organisational units.

By creating the repository with the DabbleDB web platform we can eliminate development costs and create a hassle-free hosting solution.

If you missed the first post in this series which discussed the benefits and uses of data quality rules please click here.

Please click on the following image to view the tutorial video or click this link: How to build a DQ Rules Repository

Data Quality Rules Tutorial

Useful Resources

• How to create a data quality rules management repository (Part 1 - What are data quality rules?)
• Iergo free online data migration training (providers of DQ Rules template)

8 data migration benefits of logical and conceptual data models

The use of logical and conceptual data models is often a rarity in data migration projects but when adopted correctly they can create significant benefits for both the business and technical community.

In this post we take a closer look at some of the reasons why they can prove so useful.

Click to read more ...

Interview with Expressor Software CEO, Bob Potter

We recently spoke with Expressor Software CEO, Bob Potter to find out more about their data integration technology, how it can benefit data migration initiatives and what their plans are for the future.

Click to read more ...

Does your data migration strategy have an effective plan for systems retirement?

In this article we discuss the challenges of ensuring that those ageing systems you have migrated from can head off gracefully into the sunset.

We've also posted 25 data migration best-practices to ensure your business is ready, willing and able to retire its legacy landscape post-migration.

Click to read more ...

Free data quality pattern analysis tool for Excel, will help cash-strapped data discovery analysts

If you're a new visitor to the site you may not know that our sister site, Data Quality Pro, frequently releases great new community tools that directly benefit the data migration folk on this site.

The latest tool to be created is free to members and like all our tools falls under a creative commons license which means you can use it, change it and share it but please don't sell it without our consent!

It is called the "Pattern Analyser for Excel" and it will help you discover data rules for pattern formats, trap insidious defects you definitely do not want to be migrating and generally beef up your data analysis activities.

In the post we also list our other free tools so far released, pattern analysis for MS-Access and Oracle.

It's free, takes only 20 seconds to download and we've even published a simple tutorial showing a few examples.

Just check out this post for details of the tutorial and how to download the tool.

8 Data Migration Resolutions for 2009

In this article we present 8 activities that have been proven to improve the likelihood of success in data migration projects.

Why not treat them as resolutions for the coming year?

Expand, share, critique but above all learn from them and spot opportunities to implement them when conditions are right.

Click to read more ...