Normalised records
Normalised records (silver)
Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.
Normalised rows
99,495
usable in matching
Flagged rows
99,881
99.9% carry at least one flag
Junk quarantined
505
no usable last name
Average quality score
0.75
1.00 = no corrections needed
Quality flags
What normalisation had to do, and how often. Select a flag to filter the table.
- Placeholder values cleared71,257Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
- Whitespace trimmed57,061Leading or trailing whitespace removed from one or more fields
- Address re-cased56,490Street line re-cased and punctuation removed
- Street suffix standardised55,824Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
- Phone reformatted50,244Phone reduced to ten digits, punctuation and leading country code removed
- Name re-cased39,996Name letter-case rewritten to Title Case and stray characters removed
- Date of birth reformatted32,400Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
- City re-cased17,850City re-cased to Title Case
- Gender normalised16,828Gender mapped to F or M from a longer or variant value
- Email lower-cased11,635Email lower-cased
- Name split from “Last, First”9,980First-name field held "LAST, FIRST"; the two parts were split into their own fields
- State name converted to code9,084Full state name replaced by its two-letter USPS code
- ZIP+4 trimmed8,263ZIP+4 trimmed to the five-digit ZIP
- Member ID reformatted7,723Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
- ZIP missing7,146Street address present but no ZIP supplied
- Unit split from street6,994Apartment, suite or unit designator split from street line and re-appended in standard form
- Two-digit birth year6,661Date of birth carried a two-digit year; century inferred by pivot
- State code upper-cased4,010Two-letter state code upper-cased
- Plan code upper-cased3,278Plan code upper-cased
- SSN last four extracted2,817Last four digits of SSN extracted from a longer or punctuated value
- Date of birth unreadable2,274Date of birth did not match any known format or was out of range; cleared
- Phone missing area code2,021Phone had only seven digits (no area code); cleared
- Middle initial moved out of first name1,125A single middle initial was embedded in the first-name field and moved to middle name
- Date of birth missing990Date of birth absent or a null token; left empty
- No usable name (quarantined)505No usable last name; record quarantined as junk and excluded from matching
Normalised records
All sources, flag “Date of birth unreadable”, lowest dq score first
| Record | Source | Name | DOB | Member ID | Phone | Address | Quality score | Flags |
|---|---|---|---|---|---|---|---|---|
| TPA-52472 | TPA | Alexander R Oliver | — | — | — | — | 0.84 | Date of birth unreadablePlaceholder values cleared |
| ENR-142931 | ENR | Melissa B Perez | — | UHC-17175-25 | 9395377186 | 631 Union St, Sacramento, CA, 95842 | 0.84 | Date of birth unreadablePhone reformatted |
| TPA-54189 | TPA | Bruce A Adams | — | UHC-22515-20 | — | 1940 Grand Ave, Austin, TX, 78733 | 0.84 | Date of birth unreadablePlaceholder values cleared |
| CLM-425616 | CLM | Aaron Nunez | — | — | — | — | 0.84 | Date of birth unreadablePlaceholder values cleared |
| ENR-106586 | ENR | Kathleen C Wagner | — | UHC-50953-59 | 2303262343 | 8548 Bayshore Dr, Seattle, WA, 98166 | 0.84 | Date of birth unreadablePhone reformatted |
| ENR-111618 | ENR | Emma N Dunn | — | UHC-28577-51 | 6095564294 | 7042 Broadway, Chandler, AZ, 85249 | 0.84 | Date of birth unreadableWhitespace trimmed |
| ENR-100876 | ENR | Logan Gardner | — | UHC-91262-32 | 6242686654 | 7230 Park Pl, Scottsdale, AZ, 85272 | 0.84 | Date of birth unreadableWhitespace trimmed |
| CLM-420922 | CLM | Denise Lucas | — | UHC-21721-41 | — | — | 0.84 | Date of birth unreadablePlaceholder values cleared |
| CLM-427570 | CLM | Donald Adams | — | UHC-26650-54 | — | 9804 Sunset Blvd, Plano, TX, 75003 | 0.84 | Date of birth unreadablePlaceholder values cleared |
| ENR-139762 | ENR | Jeremy Hunt | — | UHC-59297-43 | — | 4716 Sunset Blvd, Jacksonville, FL, 32236 | 0.84 | Date of birth unreadablePlaceholder values cleared |
| ENR-133863 | ENR | Raymond Jenkins | — | UHC-34809-40 | 9199131442 | 669 Washington St, Plano, TX, 75097 | 0.84 | Date of birth unreadableWhitespace trimmed |
| CLM-406040 | CLM | Larry Barnes | — | UHC-76599-05 | — | — | 0.84 | Date of birth unreadablePlaceholder values cleared |
| CLM-412252 | CLM | Jordan Wheeler | — | UHC-10993-15 | — | 9746 Mesa Dr, Mesa, AZ, 85258 | 0.84 | Date of birth unreadablePlaceholder values cleared |
| CLM-422255 | CLM | Bobby Santos | — | UHC-83369-97 | — | 7250 Apache Blvd, Dallas, TX, 75217 | 0.84 | Date of birth unreadablePlaceholder values cleared |
| TPA-56715 | TPA | Hiroshi Bkaer | — | — | — | — | 0.84 | Date of birth unreadablePlaceholder values cleared |
| CLM-409744 | CLM | Jennifer Carr | — | — | — | — | 0.84 | Date of birth unreadablePlaceholder values cleared |
| TPA-51953 | TPA | Alan Soto | — | — | 7157709265 | — | 0.84 | Date of birth unreadablePlaceholder values cleared |
| CLM-401413 | CLM | Nathan Montgomery | — | UHC-06179-36 | — | 1072 Pine Dr, Phoenix, AZ, 85053 | 0.84 | Date of birth unreadablePlaceholder values cleared |
| CLM-407075 | CLM | Angela Sanders | — | UHC-47771-45 | — | — | 0.84 | Date of birth unreadablePlaceholder values cleared |
| ENR-120841 | ENR | Randy Robertson | — | UHC-77559-84 | 4489147374 | 4391 Baseline Rd, Columbus, OH, 43230 | 0.86 | Date of birth unreadable |
| ENR-106427 | ENR | Christopher Welch | — | UHC-41607-47 | 6949201547 | 8198 Grand Ave, Orlando, FL, 32871 | 0.86 | Date of birth unreadable |
| ENR-104223 | ENR | Jean Contreras | — | UHC-29251-65 | 2555930153 | 3730 Hillcrest Rd, San Antonio, TX, 78202 | 0.86 | Date of birth unreadable |
| ENR-102419 | ENR | Marcus Grifffin | — | UHC-10120-08 | — | 4569 Grand Ave, San Diego, CA, 92129 | 0.86 | Date of birth unreadable |
| ENR-100524 | ENR | Terry Richardson | — | UHC-04412-61 | 7636692754 | 2542 Jefferson Ave, Atlanta, GA, 30395 | 0.86 | Date of birth unreadable |