Normalised records
Normalised records (silver)
Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.
Normalised rows
99,495
usable in matching
Flagged rows
99,881
99.9% carry at least one flag
Junk quarantined
505
no usable last name
Average quality score
0.75
1.00 = no corrections needed
Quality flags
What normalisation had to do, and how often. Select a flag to filter the table.
- Placeholder values cleared71,257Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
- Whitespace trimmed57,061Leading or trailing whitespace removed from one or more fields
- Address re-cased56,490Street line re-cased and punctuation removed
- Street suffix standardised55,824Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
- Phone reformatted50,244Phone reduced to ten digits, punctuation and leading country code removed
- Name re-cased39,996Name letter-case rewritten to Title Case and stray characters removed
- Date of birth reformatted32,400Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
- City re-cased17,850City re-cased to Title Case
- Gender normalised16,828Gender mapped to F or M from a longer or variant value
- Email lower-cased11,635Email lower-cased
- Name split from “Last, First”9,980First-name field held "LAST, FIRST"; the two parts were split into their own fields
- State name converted to code9,084Full state name replaced by its two-letter USPS code
- ZIP+4 trimmed8,263ZIP+4 trimmed to the five-digit ZIP
- Member ID reformatted7,723Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
- ZIP missing7,146Street address present but no ZIP supplied
- Unit split from street6,994Apartment, suite or unit designator split from street line and re-appended in standard form
- Two-digit birth year6,661Date of birth carried a two-digit year; century inferred by pivot
- State code upper-cased4,010Two-letter state code upper-cased
- Plan code upper-cased3,278Plan code upper-cased
- SSN last four extracted2,817Last four digits of SSN extracted from a longer or punctuated value
- Date of birth unreadable2,274Date of birth did not match any known format or was out of range; cleared
- Phone missing area code2,021Phone had only seven digits (no area code); cleared
- Middle initial moved out of first name1,125A single middle initial was embedded in the first-name field and moved to middle name
- Date of birth missing990Date of birth absent or a null token; left empty
- No usable name (quarantined)505No usable last name; record quarantined as junk and excluded from matching
Normalised records
Third-party administrator, flag “Email lower-cased”, lowest dq score first
| Record | Source | Name | DOB | Member ID | Phone | Address | Quality score | Flags |
|---|---|---|---|---|---|---|---|---|
| TPA-59179 | TPA | Ana Ortiz | 1959-05-28 | — | — | 1779 Central Ave, Atlanta, GA, 30336 | 0.94 | Date of birth reformattedEmail lower-casedPlaceholder values cleared |
| TPA-56402 | TPA | Patricia Peters | 2000-10-03 | UHC-65406-11 | — | — | 0.94 | Name re-casedEmail lower-casedPlaceholder values cleared |
| TPA-56081 | TPA | Janeet Y Reynolds | 1994-06-27 | — | — | — | 0.94 | Name re-casedEmail lower-casedPlaceholder values cleared |
| TPA-56756 | TPA | Bobby Chapman | 1998-07-14 | — | 6199083428 | 3244 Central Ave, San Diego, CA, 92182 | 0.94 | Phone reformattedEmail lower-casedPlaceholder values cleared |
| TPA-50972 | TPA | Abigail Snyder | 1997-05-24 | — | — | — | 0.94 | Date of birth reformattedEmail lower-casedPlaceholder values cleared |
| TPA-63685 | TPA | Arthur Morrison | 1995-07-18 | — | — | — | 0.94 | Name re-casedEmail lower-casedPlaceholder values cleared |
| TPA-60864 | TPA | Paul X Evans | 1972-11-03 | — | — | — | 0.94 | Email lower-casedWhitespace trimmedPlaceholder values cleared |
| TPA-54315 | TPA | Vincent Bailey | 1979-04-26 | — | — | 558 Cedar Ln, Los Angeles, CA, 90027 | 0.94 | Name re-casedEmail lower-casedPlaceholder values cleared |
| TPA-60916 | TPA | Christine Le | 1976-04-22 | — | — | 6862 Ridge Rd, San Antonio, TX, 78299 | 0.94 | State code upper-casedEmail lower-casedPlaceholder values cleared |
| TPA-54290 | TPA | Amy Kennedy | 1947-06-19 | UHC-82897-98 | 6655382478 | 2061 Canyon Rd, Atlanta, GA, 30382 | 0.94 | Date of birth reformattedEmail lower-casedPlaceholder values cleared |
| TPA-56991 | TPA | Sandra Russell | 1995-02-25 | — | — | 4459 Hillcrest Rd, Chandler, AZ, 85293 | 0.94 | City re-casedEmail lower-casedPlaceholder values cleared |
| TPA-57524 | TPA | Campbell Amanda | 1940-10-01 | — | 5622652929 | 8762 Indian School Rd, Orlando, FL, 32834 | 0.94 | Date of birth reformattedEmail lower-casedPlaceholder values cleared |
| TPA-62379 | TPA | Mary Brown | 2006-08-18 | — | — | 5961 Ridge Rd, Mesa, AZ, 85268 | 0.96 | Date of birth reformattedEmail lower-cased |
| TPA-61295 | TPA | Tim Lawrence | 1973-06-15 | UHC-34368-51 | — | — | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-54622 | TPA | Olivia Cox | 2001-08-05 | — | — | — | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-53141 | TPA | Eric Li | 1950-05-15 | — | 7388743624 | 8657 Ocean Ave, Fresno, CA, 93773 | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-59968 | TPA | Eric G Perkins | 1999-11-21 | — | — | 7227 Sunset Blvd, Tampa, FL, 33639 | 0.96 | Name re-casedEmail lower-cased |
| TPA-59296 | TPA | Brandon M Aguilar | 1950-12-15 | — | — | 7796 Maple Ave, Tucson, AZ, 85743 | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-51781 | TPA | Sean Allen | 1993-09-14 | UHC-37430-07 | — | 1226 Willow Ct, Los Angeles, CA, 90091 | 0.96 | Member ID reformattedEmail lower-cased |
| TPA-59232 | TPA | Jesse Perkins | 1985-04-16 | UHC-20153-76 | 7329691671 | — | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-55880 | TPA | Jesse Richards | 1969-03-05 | — | — | 1959 Lincoln Way, Las Vegas, NV, 89135 | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-51872 | TPA | Jason Delgado | 1975-09-08 | — | — | 4130 Meadow Ln, Minneapolis, MN, 55460 | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-54429 | TPA | Abigail Reynolds | 1976-04-27 | — | — | 8152 Ocean Ave, Seattle, WA, 98149 | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-55483 | TPA | Nathan P Hanson | 1990-08-26 | — | — | 964 Lincoln Way, Austin, TX, 78716 | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-60831 | TPA | Santiago Franklin | 1954-10-10 | — | — | 8938 Union St, Gilbert, AZ, 85212 | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-59240 | TPA | Joyce Rodriguez | 1961-10-22 | UHC-59693-27 | — | — | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-61474 | TPA | Aisha Sullivan | 1941-02-07 | — | — | 4715 Grand Ave, Gilbert, AZ, 85222 | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-61588 | TPA | Gary Gray | 1961-07-03 | — | — | 462 Grand Ave, Nashville, TN, 37249 | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-50800 | TPA | Anthony Hernandez | 2003-01-03 | — | — | 8512 Mesa Dr, Scottsdale, AZ, 85269 | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-60073 | TPA | Ross H Benjamin | 1945-12-11 | — | — | — | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-64104 | TPA | Jeffrey Grant | 1983-09-13 | — | — | — | 0.96 | Email lower-casedPlaceholder values cleared |
| TPA-50767 | TPA | Bradley Rice | 1983-03-12 | — | 2807381003 | 4855 Bayshore Dr, Atlanta, GA, 30350 | 0.98 | Email lower-cased |