Normalised records
Normalised records (silver)
Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.
Normalised rows
99,495
usable in matching
Flagged rows
99,881
99.9% carry at least one flag
Junk quarantined
505
no usable last name
Average quality score
0.75
1.00 = no corrections needed
Quality flags
What normalisation had to do, and how often. Select a flag to filter the table.
- Placeholder values cleared71,257Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
- Whitespace trimmed57,061Leading or trailing whitespace removed from one or more fields
- Address re-cased56,490Street line re-cased and punctuation removed
- Street suffix standardised55,824Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
- Phone reformatted50,244Phone reduced to ten digits, punctuation and leading country code removed
- Name re-cased39,996Name letter-case rewritten to Title Case and stray characters removed
- Date of birth reformatted32,400Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
- City re-cased17,850City re-cased to Title Case
- Gender normalised16,828Gender mapped to F or M from a longer or variant value
- Email lower-cased11,635Email lower-cased
- Name split from “Last, First”9,980First-name field held "LAST, FIRST"; the two parts were split into their own fields
- State name converted to code9,084Full state name replaced by its two-letter USPS code
- ZIP+4 trimmed8,263ZIP+4 trimmed to the five-digit ZIP
- Member ID reformatted7,723Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
- ZIP missing7,146Street address present but no ZIP supplied
- Unit split from street6,994Apartment, suite or unit designator split from street line and re-appended in standard form
- Two-digit birth year6,661Date of birth carried a two-digit year; century inferred by pivot
- State code upper-cased4,010Two-letter state code upper-cased
- Plan code upper-cased3,278Plan code upper-cased
- SSN last four extracted2,817Last four digits of SSN extracted from a longer or punctuated value
- Date of birth unreadable2,274Date of birth did not match any known format or was out of range; cleared
- Phone missing area code2,021Phone had only seven digits (no area code); cleared
- Middle initial moved out of first name1,125A single middle initial was embedded in the first-name field and moved to middle name
- Date of birth missing990Date of birth absent or a null token; left empty
- No usable name (quarantined)505No usable last name; record quarantined as junk and excluded from matching
Normalised records
Third-party administrator, flag “Date of birth reformatted”, lowest dq score first
| Record | Source | Name | DOB | Member ID | Phone | Address | Quality score | Flags |
|---|---|---|---|---|---|---|---|---|
| TPA-59899 | TPA | Willie Myers | 1941-07-13 | — | — | 283 Lake View Rd, Las Vegas, NV, 89189 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-56952 | TPA | Doris Y Meyer | 1961-05-19 | — | — | — | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-61667 | TPA | Rachel Carroll | 1968-07-14 | — | — | 8789 Valley View Dr, Sacramento, CA, 95843 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-56091 | TPA | Katherine Porter | 1945-05-01 | — | — | — | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-51283 | TPA | Carol Snyder | 1966-06-27 | — | — | — | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-53949 | TPA | Jennifer Scott | 1999-04-26 | UHC-64421-36 | — | — | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-54146 | TPA | Maria Park | 1979-04-01 | — | — | 1510 Grand Ave, Phoenix, AZ, 85034 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-57977 | TPA | Dot Austyn | 1949-11-11 | — | — | 8657 Oak St, Los Angeles, CA, 90068 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-62639 | TPA | Kayla Vazquez | 1973-04-11 | — | 2155378276 | — | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-57792 | TPA | Raymond Richards | 2004-02-17 | — | 6152665615 | — | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-51978 | TPA | John West | 1938-01-22 | — | — | 8348 Market St, Austin, TX, 78748 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-55767 | TPA | Austin I Walker | 1943-04-08 | — | — | 357 Lake View Rd, Orlando, FL, 32816 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-60842 | TPA | Eugene Nichols | 1980-03-11 | UHC-77317-26 | — | 1911 Palm Dr, Phoenix, AZ, 85031 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-60586 | TPA | Megan L Kim | 2008-03-28 | — | — | — | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-54572 | TPA | Cynthia Hunter | 2007-09-01 | — | 7594934343 | 5520 Elm St, Seattle, WA, 98166 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-63073 | TPA | Stephanie Yang | 2002-09-03 | — | — | 6020 Ocean Ave, Charlotte, NC, 28250 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-62069 | TPA | Gregory Sandoval | 1979-02-21 | UHC-93440-38 | — | 1634 Mesa Dr, Jacksonville, FL, 32266 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-58040 | TPA | Russell Z Price | 1985-02-12 | — | — | — | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-52846 | TPA | Evelyn Simmons | 1972-03-10 | — | — | — | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-62328 | TPA | Kevin Fernandez | 1971-05-07 | — | — | — | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-62609 | TPA | Victoria Ramos | 1996-06-08 | — | — | 6219 Lincoln Way, Fresno, CA, 93783 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-64362 | TPA | Wang J Charles | 1970-06-14 | UHC-77837-25 | — | 8724 Camelback Rd, Charlotte, NC, 28249 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-50737 | TPA | Virginia Castillo | 1992-06-06 | UHC-00947-15 | — | 6133 Canyon Rd, Los Angeles, CA, 90090 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-50311 | TPA | Betsy Bailey | 1992-07-17 | — | — | 2559 Main St, Dallas, TX, 75202 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-54427 | TPA | Eric Aguilar | 1974-07-26 | — | — | 3345 Lincoln Way, Austin, TX, 78754 | 0.96 | Date of birth reformattedPlaceholder values cleared |
| TPA-56737 | TPA | Margaret Burke | 1993-12-13 | — | — | 2687 Canyon Rd, Nashville, TN, 37222 | 0.98 | Date of birth reformatted |
| TPA-55438 | TPA | Ralph Z Luna | 1978-12-05 | — | — | 3844 Forest Ave, Houston, TX, 77070 | 0.98 | Date of birth reformatted |
| TPA-54709 | TPA | Keith B Olson | 2006-03-05 | — | 9494048924 | 500 Highland Ave, Sacramento, CA, 95828 | 0.98 | Date of birth reformatted |