Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Two-digit birth year”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagTwo-digit birth yearClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-414223	CLM	Michelle W Rivera	1989-06-02	UHC-89576-64	3225737826	6134 Hillcrest Rd, Tampa, FL, 33667	0.70	Two-digit birth year State name converted to code Whitespace trimmed
CLM-431598	CLM	Beverly Q Schultz	1981-07-09	UHC-83728-87	—	627 Highland Ave, Dallas, TX, 75261	0.70	Name re-cased Two-digit birth year ZIP+4 trimmed
CLM-412679	CLM	Mark X Delgado	1948-10-08	UHC-23763-86	—	2337 Mesa Dr, Tempe, AZ, 85209	0.70	Middle initial moved out of first name Two-digit birth year Placeholder values cleared
CLM-412563	CLM	Ryan Martin	2008-09-08	—	—	678 Palm Dr, Miami, FL, 33187	0.70	Two-digit birth year Gender normalised Placeholder values cleared
CLM-414472	CLM	Simmons David	1959-08-06	UHC-48775-80	6152117638	1491 Lake View Rd, Fresno, CA, 93713	0.70	Two-digit birth year Phone reformatted State name converted to code
CLM-408129	CLM	Christian Romero	1957-02-08	—	—	—	0.70	Two-digit birth year Gender normalised Placeholder values cleared
CLM-403689	CLM	Valentina Gonzalez	1995-09-13	UHC-08034-63	—	—	0.70	Two-digit birth year Gender normalised Placeholder values cleared
CLM-403082	CLM	Jose M Howell	1979-11-01	UHC-12973-72	—	—	0.70	Two-digit birth year Gender normalised Placeholder values cleared
CLM-432469	CLM	Aaron D Salazar	1990-08-04	—	—	—	0.70	Name split from “Last, First”Two-digit birth year Placeholder values cleared
CLM-415968	CLM	Patrick J Gardner	2000-08-12	UHC-61113-46	—	—	0.70	Two-digit birth year Gender normalised Placeholder values cleared
CLM-428035	CLM	Lawrence L Johnston	1981-05-16	UHC-28017-01	—	—	0.70	Middle initial moved out of first name Two-digit birth year Placeholder values cleared
CLM-416735	CLM	Omar Chavez	1976-12-25	UHC-90070-55	3699654622	2433 Baseline Rd, Seattle, WA, 98132	0.70	Two-digit birth year Phone reformatted Gender normalised
CLM-405233	CLM	Victuria Hawkins	1973-05-10	—	—	—	0.70	Two-digit birth year Gender normalised Placeholder values cleared
CLM-411648	CLM	Nicholas Ryan	2006-10-26	UHC-54730-66	9654173413	565 Sunset Blvd, Phoenix, AZ, 85030	0.70	Name split from “Last, First”Two-digit birth year Phone reformatted
CLM-431446	CLM	Benjamin Parker	1988-03-13	—	—	1109 Grand Ave, Chandler, AZ, 85226	0.70	Two-digit birth year SSN last four extracted Placeholder values cleared
CLM-401000	CLM	Diana Stevens	1981-11-16	UHC-59010-76	—	7736 Valley View Dr, Nashville, TN, 37249	0.70	Name split from “Last, First”Two-digit birth year Placeholder values cleared
CLM-430921	CLM	Betty X Perez	1997-03-07	—	—	—	0.70	Name split from “Last, First”Two-digit birth year Placeholder values cleared
CLM-402874	CLM	Stephen Ray	1957-01-19	UHC-90976-19	—	630 Lake View Rd, San Antonio, TX, 78228	0.70	Two-digit birth year ZIP+4 trimmed Placeholder values cleared
CLM-422953	CLM	Nancy Soto	1954-12-24	—	—	437 Maple Ave, Los Angeles, CA, 90039	0.70	Name split from “Last, First”Two-digit birth year Placeholder values cleared
CLM-407708	CLM	Michelle Luna	2001-07-03	UHC-80345-60	—	2555 Pine Dr, Los Angeles, CA, 90092	0.70	Two-digit birth year Gender normalised Placeholder values cleared
CLM-415656	CLM	Jack Garza	1965-12-27	UHC-07484-53	—	—	0.70	Two-digit birth year Phone missing area code Placeholder values cleared
CLM-429102	CLM	Brenda Phillips	1961-06-05	—	8043537023	1876 Central Ave, Miami, FL	0.70	Two-digit birth year ZIP missing Placeholder values cleared
CLM-420718	CLM	Matthew Smith	1972-11-15	UHC-99615-97	—	9483 Apache Blvd, San Diego, CA, 92190	0.70	Two-digit birth year Gender normalised Placeholder values cleared
CLM-401353	CLM	Julia Ortega	1975-07-12	UHC-75167-48	—	—	0.70	Two-digit birth year SSN last four extracted Placeholder values cleared
CLM-418991	CLM	Kelly N Gonzales	1965-12-21	UHC-01397-49	—	4772 Forest Ave, Plano, TX, 75014	0.70	Name split from “Last, First”Two-digit birth year Placeholder values cleared
CLM-418990	CLM	Kelly N Gonzales	1965-12-21	UHC-01397-49	—	4772 Forest Ave, Plano, TX, 75014	0.70	Name split from “Last, First”Two-digit birth year Placeholder values cleared
CLM-425231	CLM	Bradley Cole	1966-12-02	UHC-02912-63	3476095712	802 Canyon Rd, Scottsdale, AZ, 85213	0.70	Name re-cased Two-digit birth year Gender normalised
CLM-425113	CLM	Gray Lawrence	2008-10-13	UHC-31573-55	—	—	0.70	Two-digit birth year Gender normalised Placeholder values cleared
CLM-417314	CLM	Jason Wheeler	1954-08-10	—	—	—	0.70	Name split from “Last, First”Two-digit birth year Placeholder values cleared
CLM-405882	CLM	—Junk	1981-01-01	UHC-84724-16	—	—	0.70	Two-digit birth year Placeholder values cleared No usable name (quarantined)
CLM-400022	CLM	Don R Cole	2002-06-28	UHC-90325-35	—	2476 Broadway, Columbus, OH, 43240	0.70	Two-digit birth year ZIP+4 trimmed Placeholder values cleared
CLM-410135	CLM	Andy Little	1972-07-06	UHC-11547-97	—	7344 Oak St, Chandler, AZ, 85276	0.70	Name split from “Last, First”Two-digit birth year Placeholder values cleared
CLM-413336	CLM	—Junk	1945-01-25	UHC-69613-43	—	—	0.70	Two-digit birth year Placeholder values cleared No usable name (quarantined)
CLM-402617	CLM	Keith X Wells	1951-03-11	UHC-14936-06	2749000423	9270 Camelback Rd, San Antonio, TX, 78287	0.70	Two-digit birth year Gender normalised Whitespace trimmed
CLM-417748	CLM	JoseJunk	1979-05-02	UHC-23800-23	7915452789	1716 Ridge Rd, Nashville, TN, 37283	0.70	Two-digit birth year Placeholder values cleared No usable name (quarantined)
CLM-420037	CLM	Mark Lewis	1995-06-14	UHC-34718-55	—	1859 Indian School Rd, Austin, TX, 78766	0.70	Two-digit birth year Street suffix standardised Address re-cased
CLM-401373	CLM	Arjun Gardner	1987-08-28	UHC-24635-15	4878303467	—	0.70	Two-digit birth year Phone reformatted Gender normalised
CLM-400122	CLM	Sofia Lawson	1963-09-07	UHC-68415-31	—	—	0.70	Two-digit birth year Gender normalised Placeholder values cleared
CLM-409037	CLM	Donna Schmidt	1983-02-23	UHC-88832-04	—	—	0.70	Name split from “Last, First”Two-digit birth year Placeholder values cleared
CLM-412023	CLM	Randy C Sims	1983-10-01	—	—	7983 Church St, Atlanta, GA	0.70	Two-digit birth year ZIP missing Placeholder values cleared
CLM-421666	CLM	Eric Dixon	1991-11-09	UHC-22960-96	—	4973 Maple Ave, Chandler, AZ, 85287	0.70	Two-digit birth year Gender normalised Placeholder values cleared
CLM-406905	CLM	Lawrence Rice	1955-11-12	—	—	—	0.70	Two-digit birth year Gender normalised Placeholder values cleared
CLM-405889	CLM	Amber Rose	2005-12-17	—	6554661186	—	0.70	Two-digit birth year Gender normalised Placeholder values cleared
CLM-429325	CLM	Albert Flores	2002-11-06	—	—	—	0.70	Two-digit birth year Gender normalised Placeholder values cleared
CLM-409253	CLM	Douglas Harris	1941-12-09	UHC-15357-52	—	—	0.72	Two-digit birth year Phone missing area code
CLM-425637	CLM	Margaret Vgea	1938-05-15	—	—	8191 Grand Ave, Las Vegas, NV	0.72	Two-digit birth year ZIP missing
CLM-404911	CLM	Bruce Ferguson	1977-04-10	UHC-65891-58	—	—	0.72	Two-digit birth year Phone missing area code
CLM-410921	CLM	Mary Morales	1998-04-27	UHC-10683-37	9196515365	738 Broadway, Sacramento, CA, 95819	0.72	Name re-cased Two-digit birth year Phone reformatted Member ID reformatted+4 more
CLM-420242	CLM	Emma Pena	2007-12-15	UHC-89588-48	2135477737	—	0.76	Name re-cased Two-digit birth year Phone reformatted Member ID reformatted+2 more
CLM-407496	CLM	Martha Weaver	1978-08-11	UHC-63216-91	—	7449 Jefferson Ave, Scottsdale, AZ, 85226	0.76	Name re-cased Two-digit birth year City re-cased Email lower-cased+2 more

2,168 rows, page 31 of 44Previous Next