Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Third-party administrator, flag “Placeholder values cleared”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagPlaceholder values clearedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
TPA-56615	TPA	Rob Bowman	2000-09-24	—	—	—	0.82	Name split from “Last, First”Email lower-cased Placeholder values cleared
TPA-58766	TPA	Ronald Burton	—	—	—	8308 Washington St, Denver, CO, 80243	0.82	Date of birth reformatted Date of birth unreadable Placeholder values cleared
TPA-59175	TPA	Diana Burns	2006-11-17	UHC-40188-10	9317421158	2843 Jefferson Ave, Miami, FL, 33120	0.82	Phone reformatted ZIP+4 trimmed Placeholder values cleared
TPA-50545	TPA	Karen Martinez	1972-11-01	—	—	—	0.82	Name split from “Last, First”Whitespace trimmed Placeholder values cleared
TPA-63841	TPA	Richard Medina	1972-05-09	UHC-46415-43	9364135708	—	0.82	Name re-cased Gender normalised Placeholder values cleared
TPA-59121	TPA	Edward Jacobs	1954-03-15	—	—	—	0.82	Name split from “Last, First”Whitespace trimmed Placeholder values cleared
TPA-58847	TPA	Madison B Henderson	1985-12-16	—	—	2197 Highland Ave, San Diego, CA	0.82	Name re-cased ZIP missing Placeholder values cleared
TPA-63533	TPA	Patricia Mendez	1987-03-22	—	—	6039 Highland Ave, Tucson, AZ, 85767	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
TPA-58452	TPA	Mary Diaz	1973-09-23	—	5429755897	7006 Highland Ave, Seattle, WA, 98111	0.82	Name re-cased Two-digit birth year Placeholder values cleared
TPA-55521	TPA	Karen Wagner	1995-02-07	—	—	3199 Market St, Nashville, TN, 37213	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-58533	TPA	Adam Wheeler	1950-10-17	—	—	—	0.82	Name split from “Last, First”Date of birth reformatted Placeholder values cleared
TPA-51156	TPA	Rebecca Mitchell	1963-07-21	—	—	6206 Bayshore Dr, Houston, TX, 77099	0.82	SSN last four extracted Whitespace trimmed Placeholder values cleared
TPA-60455	TPA	Luis Gilbert	2002-05-27	—	—	2140 Lake View Rd, Columbus, OH, 43250	0.82	Name split from “Last, First”Whitespace trimmed Placeholder values cleared
TPA-53814	TPA	Nathan Bennett	1952-12-14	UHC-27614-09	—	2690 Lincoln Way, Denver, CO, 80206	0.82	State name converted to code Plan code upper-cased Placeholder values cleared
TPA-53361	TPA	Jose Munoz	2004-08-05	—	—	—	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
TPA-53360	TPA	Jose Munoz	2004-08-05	—	—	—	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
TPA-54139	TPA	Angela Wang	1967-03-01	—	—	8641 Valley View Dr, Orlando, FL, 32887	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-50448	TPA	Arjun McCoy	1954-10-07	—	—	2077 Spring St, Dallas, TX, 75247	0.82	Date of birth reformatted Phone missing area code Placeholder values cleared
TPA-50925	TPA	Catherine Phillips	1981-08-26	—	—	8247 Desert Sky Blvd, Seattle, WA, 98164	0.82	Name re-cased Gender normalised Placeholder values cleared
TPA-59331	TPA	Gerald Rios	1976-03-19	—	—	3000 Maple Ave, San Antonio, TX, 78252	0.82	Two-digit birth year Email lower-cased Placeholder values cleared
TPA-61689	TPA	Margaret F Weaver	1989-04-17	UHC-13952-43	—	—	0.82	Name split from “Last, First”Date of birth reformatted Placeholder values cleared
TPA-53989	TPA	Kevin Z Taylor	1978-04-04	—	—	9498 Main St, Eden Prairie, MN, 55326	0.82	Middle initial moved out of first name Name re-cased Placeholder values cleared
TPA-57018	TPA	Ruth Flores	2008-03-05	—	—	2065 Elm St, Columbus, OH	0.82	State code upper-cased ZIP missing Placeholder values cleared
TPA-62100	TPA	Madison Reyes	1946-04-18	—	—	6130 Elm St, Orlando, FL, 32897	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-56871	TPA	Juan Williams	1950-11-24	—	—	8198 Lincoln Way, Scottsdale, AZ	0.82	Name re-cased ZIP missing Placeholder values cleared
TPA-53137	TPA	Jose Fuller	1988-04-27	—	4255450830	7713 Willow Ct, Denver, CO, 80223	0.82	Name split from “Last, First”Whitespace trimmed Placeholder values cleared
TPA-50780	TPA	Amy Rice	1991-06-04	—	7905690744	—	0.82	Name split from “Last, First”Plan code upper-cased Placeholder values cleared
TPA-58164	TPA	Lucia Guerrero	1979-04-01	UHC-85694-87	4469197984	8907 Mountain View Dr, Glendale, AZ, 85379	0.82	Name split from “Last, First”Whitespace trimmed Placeholder values cleared
TPA-60770	TPA	Ralph A Ruiz	1950-05-14	—	—	—	0.82	Name re-cased Two-digit birth year Placeholder values cleared
TPA-53248	TPA	Mark R Rojas	1975-02-01	—	—	3472 Ridge Rd, Atlanta, GA, 30381	0.82	Name re-cased Gender normalised Placeholder values cleared
TPA-59653	TPA	Priya Lynch	1982-09-24	—	—	3494 Baseline Rd, Minneapolis, MN, 55410	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-51722	TPA	Jonathan Bennett	1968-03-13	—	—	—	0.82	Gender normalised Whitespace trimmed Placeholder values cleared
TPA-56234	TPA	Kathleen Morris	1962-10-27	—	—	3402 Highland Ave, Dallas, TX, 75236	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-60855	TPA	Jerry Thomas	1975-09-28	—	4854250951	—	0.82	Phone reformatted Gender normalised Placeholder values cleared
TPA-58381	TPA	Abigail Mitchell	1968-08-24	—	2578456056	103 Broadway, Columbus, OH	0.82	ZIP missing Whitespace trimmed Placeholder values cleared
TPA-58543	TPA	Christina Morgan	1999-03-07	—	—	—	0.82	Name re-cased Gender normalised Placeholder values cleared
TPA-58345	TPA	Camila Thompson	1939-01-12	—	—	5263 Broadway, Sacramento, CA, 95880	0.82	Name split from “Last, First”Address re-cased Placeholder values cleared
TPA-51662	TPA	Mason Marquez	1998-12-04	—	—	3220 Maple Ave, Sacramento, CA, 95843	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-63667	TPA	Justin Le	1977-05-22	—	—	1662 Market St, Phoenix, AZ	0.82	ZIP missing Whitespace trimmed Placeholder values cleared
TPA-59342	TPA	Judy Santiago	1999-05-13	—	—	132 Pine Dr, Tempe, AZ, 85248	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-61793	TPA	Carl Carr	1985-06-03	—	—	—	0.82	Name re-cased Gender normalised Placeholder values cleared
TPA-63242	TPA	Jack Pierce	—	—	—	—	0.82	Date of birth unreadable Whitespace trimmed Placeholder values cleared
TPA-56526	TPA	John Henry	1944-01-19	—	—	—	0.82	Gender normalised Whitespace trimmed Placeholder values cleared
TPA-56525	TPA	John Henry	1944-01-19	—	—	—	0.82	Gender normalised Whitespace trimmed Placeholder values cleared
TPA-55846	TPA	Maria Dean	2007-10-07	—	—	6450 Lincoln Way, Tempe, AZ, 85296	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-63529	TPA	Diane Schultz	1948-08-24	—	4099193242	—	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
TPA-58565	TPA	Jerry Lane	1949-10-23	—	—	2060 Ocean Ave, Orlando, FL, 32820	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-61005	TPA	Marilyn F Lynch	1992-09-01	—	—	—	0.82	Gender normalised Whitespace trimmed Placeholder values cleared
TPA-59316	TPA	Terry Lane	1939-07-20	—	—	—	0.82	Gender normalised Whitespace trimmed Placeholder values cleared
TPA-57815	TPA	Noah Rogers	1958-04-08	—	8824235999	—	0.82	Phone reformatted Gender normalised Placeholder values cleared

14,135 rows, page 201 of 283Previous Next