Skip to content

Data migration

Data migration, from first extract to signed-off cutover

One system into another, several into one, or one into several. We take the whole route: getting the data out, working out what it means, loading it, and proving it arrived.

  1. 01ExtractWhatever the route in
  2. 02MapSigned off by you
  3. 03RehearseTimed and reconciled
  4. 04Cut overA measured window
  5. 05ReconcileEvery object, listed

Where migrations go wrong

  • Rules that differ between the old system and the new one, found after go-live instead of before.
  • Codes, flags and packed fields that nobody documented.
  • Records the new system refuses: archived, oversized or outside its limits.
  • A cutover window that was guessed rather than measured.
  • Totals that don't match, found by finance a month later.

Each of these is cheap to find in a SQL warehouse before the load and expensive to find after it. That is where we start.

Getting the data out

If there is an API, we use it. If there isn't, we read the database, parse the exports or, as a last resort, automate the screens. The route depends on what you can get at, and every route ends in the same place: tables we can query and count.

Compare the extraction routes

Several systems at once

Two CRMs into one. An ERP and a CRM into a new platform. One system split across three. We map every source to the target model once, so each lands the same way and the reconciliation still adds up across all of them.

What you get

Profiling report
Row counts, keys, nulls, orphans and oddities for every source table.
Mapping specification
Field by field, with transformations, lookups and defaults, signed off by you before the build starts.
Migration code
Repeatable and documented, so every rehearsal and the final run do exactly the same thing.
Data quality report
Each issue found, its root cause, and how to stop it coming back in the new system.
Rehearsal reports
Timings and a full reconciliation for every dry run.
Cutover runbook
Every step with its owner and timing, the go or no-go criteria and the rollback path.
Sign-off sheet
Counts, totals and spot checks for every object, with anything held back listed and explained.

How the steps fit together

Pricing

A fixed price once the scope is clear. Discovery and open-ended work on a day rate. There are no figures here because the access route and the state of the data change the effort too much to guess from a web page; a short description gets you a real answer.

Describe your systems

Tell us what you are moving from and to, and how the data can be reached. No data or credentials at this stage: a description is enough.

Describe your systems
Home
Advanced extractionOut of systems with no API or export
Data migrationOld systems into new, reconciled
IntegrationSystems kept in step after go-live
Data warehousingWarehouses the business can report from
Spreadsheets into systemsCritical workbooks rebuilt as proper systems
Partner capacitySpecialist capacity for your team
Edge casesProblems that break migrations
How a migration runsProfile to reconcile
Write-upsThree write-ups
TemplatesFree downloads
Describe your systemsSend an enquiry
Privacy notice
£ turns up as £Formats
Three date formats in one columnFormats
Money stored as floating pointFormats
Mapping specification templateExcel
Reconciliation checklistPDF
Cutover runbook outlinePDF
Copy email address[email protected]
Write an email[email protected]
Switch theme
Dan Smith on LinkedIn