Normalised records
Normalised records (silver)
Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.
Normalised rows
99,495
usable in matching
Flagged rows
99,881
99.9% carry at least one flag
Junk quarantined
505
no usable last name
Average quality score
0.75
1.00 = no corrections needed
Quality flags
What normalisation had to do, and how often. Select a flag to filter the table.
- Placeholder values cleared71,257Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
- Whitespace trimmed57,061Leading or trailing whitespace removed from one or more fields
- Address re-cased56,490Street line re-cased and punctuation removed
- Street suffix standardised55,824Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
- Phone reformatted50,244Phone reduced to ten digits, punctuation and leading country code removed
- Name re-cased39,996Name letter-case rewritten to Title Case and stray characters removed
- Date of birth reformatted32,400Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
- City re-cased17,850City re-cased to Title Case
- Gender normalised16,828Gender mapped to F or M from a longer or variant value
- Email lower-cased11,635Email lower-cased
- Name split from “Last, First”9,980First-name field held "LAST, FIRST"; the two parts were split into their own fields
- State name converted to code9,084Full state name replaced by its two-letter USPS code
- ZIP+4 trimmed8,263ZIP+4 trimmed to the five-digit ZIP
- Member ID reformatted7,723Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
- ZIP missing7,146Street address present but no ZIP supplied
- Unit split from street6,994Apartment, suite or unit designator split from street line and re-appended in standard form
- Two-digit birth year6,661Date of birth carried a two-digit year; century inferred by pivot
- State code upper-cased4,010Two-letter state code upper-cased
- Plan code upper-cased3,278Plan code upper-cased
- SSN last four extracted2,817Last four digits of SSN extracted from a longer or punctuated value
- Date of birth unreadable2,274Date of birth did not match any known format or was out of range; cleared
- Phone missing area code2,021Phone had only seven digits (no area code); cleared
- Middle initial moved out of first name1,125A single middle initial was embedded in the first-name field and moved to middle name
- Date of birth missing990Date of birth absent or a null token; left empty
- No usable name (quarantined)505No usable last name; record quarantined as junk and excluded from matching
Normalised records
Third-party administrator, flag “Gender normalised”, lowest dq score first
| Record | Source | Name | DOB | Member ID | Phone | Address | Quality score | Flags |
|---|---|---|---|---|---|---|---|---|
| TPA-61305 | TPA | George Warren | 2004-07-22 | — | — | — | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-53483 | TPA | Teresa Gutierrez | 2000-03-21 | — | 8406553103 | 6977 Hillcrest Rd, Miami, FL, 33170 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-51136 | TPA | Amy Murray | 1952-03-15 | — | — | — | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-55412 | TPA | Christopher Rivera | 1982-06-16 | — | — | — | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-61547 | TPA | Dorothy J James | 1991-07-04 | — | — | 5547 Broadway, Charlotte, NC, 28217 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-62036 | TPA | Juan Richardson | 1953-06-28 | — | — | — | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-50279 | TPA | Emma Rogers | 2001-11-18 | — | — | 6134 Lincoln Way, Phoenix, AZ, 85048 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-59031 | TPA | Juan Thompson | 1991-10-12 | — | — | — | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-55224 | TPA | Johhn Sanders | 1999-07-08 | — | — | 7846 Mountain View Dr, Plano, TX, 75075 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-60718 | TPA | Marcus Myers | 1989-08-13 | — | — | 95 Lake View Rd, Tucson, AZ, 85700 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-62752 | TPA | Logan Scott | 1988-08-15 | — | 5052434196 | 9396 Cedar Ln, Nashville, TN, 37243 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-51699 | TPA | Margaret Kelley | 1961-12-02 | — | — | 6289 Jefferson Ave, Las Vegas, NV, 89138 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-57877 | TPA | Matthew Watkins | 1982-07-05 | — | — | 9357 Valley View Dr, Minneapolis, MN, 55478 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-51372 | TPA | Sarah U Crawford | 1996-06-24 | — | — | 8210 Cedar Ln, Columbus, OH, 43297 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-54683 | TPA | Gabriel Stephens | 2005-02-09 | — | — | 3126 Palm Dr, Denver, CO, 80225 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-50285 | TPA | Donna Garza | 1972-02-09 | — | — | — | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-52789 | TPA | Philip Berry | 1944-09-03 | — | — | — | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-61355 | TPA | Brenda Rodriguez | 1957-10-04 | — | — | 4390 Baseline Rd, Tucson, AZ, 85738 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-52103 | TPA | Julie Z Greene | 1949-07-10 | — | — | 233 Maple Ave, Eden Prairie, MN, 55376 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-60485 | TPA | Philip Sanchez | 2003-06-24 | — | — | 8972 Church St, Gilbert, AZ, 85203 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-56754 | TPA | Daniel Warren | 2007-05-06 | — | — | — | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-60636 | TPA | Laura Patterson | 2006-10-22 | — | — | — | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-51566 | TPA | Emma Watson | 1991-08-15 | — | — | — | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-51598 | TPA | Valentina Gonzalez | 1995-09-13 | — | — | 1832 Highland Ave, Eden Prairie, MN, 55336 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-60027 | TPA | Ethan Fernandez | 2000-08-05 | — | 9734901084 | 3381 Church St, San Diego, CA, 92166 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-58143 | TPA | Joshua Warren | 1949-05-13 | — | — | 497 Baseline Rd, Orlando, FL, 32831 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-50895 | TPA | Eric Evans | 1979-11-17 | — | — | — | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-50896 | TPA | Eric Evans | 1979-11-17 | — | — | — | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-52126 | TPA | Michael Chappman | 1938-11-13 | — | — | 5220 Church St, Atlanta, GA, 30325 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-56626 | TPA | Cynthia Sandars | 1982-11-05 | — | — | 3725 Central Ave, Tempe, AZ, 85213 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-61546 | TPA | Ryan Gibson | 2000-03-01 | — | — | — | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-52199 | TPA | Isabella B Lawrence | 1943-05-05 | — | 2977052794 | 2092 Indian School Rd, Minneapolis, MN, 55462 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-50846 | TPA | Charlotte Alexander | 2001-07-07 | — | — | 903 Meadow Ln, Houston, TX, 77049 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-57068 | TPA | Michelle Taylor | 2003-11-02 | — | — | 9367 Park Pl, Tucson, AZ, 85790 | 0.84 | Gender normalisedPlaceholder values cleared |
| TPA-62282 | TPA | Michelle Harper | 1952-04-17 | UHC-59426-45 | — | 3693 Union St, Plano, TX, 75080 | 0.86 | Gender normalised |