Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Phone reformatted”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagPhone reformattedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-401589	CLM	Gloria X Chapman	1945-07-20	UHC-02870-23	6343153093	9217 Elm St, Phoenix, AZ, 85055	0.82	Phone reformatted ZIP+4 trimmed Placeholder values cleared
CLM-401045	CLM	Martha Bailey	1972-11-04	UHC-06979-99	5147272912	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-421458	CLM	Samantha Ray	1990-09-03	—	4922997700	464 Jefferson Ave, Denver, CO	0.82	Phone reformatted ZIP missing Email lower-cased
CLM-409112	CLM	Zachary Ray	2007-06-03	UHC-38123-88	2036671378	383 Sunset Blvd Apt 16, Plano, TX, 75026	0.82	Phone reformatted Unit split from street Placeholder values cleared
CLM-428264	CLM	Jason Morgan	—	UHC-31457-91	5042718566	—	0.82	Date of birth missing Phone reformatted Placeholder values cleared
CLM-426960	CLM	Jenny Day	1981-07-20	UHC-99222-63	4942094559	2217 Elm St Apt 27, Houston, TX, 77097	0.82	Phone reformatted Unit split from street Whitespace trimmed
CLM-422860	CLM	Cynthia Ortega	2002-07-08	—	2574457724	3415 Canyon Rd, Nashville, TN, 37299	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-408507	CLM	Evelyn Valdez	—	UHC-12756-19	2987547342	—	0.82	Date of birth unreadable Phone reformatted Placeholder values cleared
CLM-408964	CLM	Gerald Sanders	—	UHC-66151-99	7664726420	—	0.82	Date of birth unreadable Phone reformatted Placeholder values cleared
CLM-419935	CLM	Arjun Jones	1979-06-19	UHC-20049-53	7618994381	5653 Spring St, Mesa, AZ, 85223	0.82	Date of birth reformatted Phone reformatted ZIP+4 trimmed
CLM-410543	CLM	Nicole Nunez	1963-04-16	UHC-05490-19	5978033519	6643 Valley View Dr, Dallas, TX, 75277	0.82	Phone reformatted ZIP+4 trimmed Whitespace trimmed
CLM-418402	CLM	Eugene Lane	1976-10-05	UHC-40068-81	5136881153	8792 Main St, Charlotte, NC, 28286	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-432032	CLM	Heny King	1953-06-24	UHC-09665-72	8449914219	7813 Park Pl, Scottsdale, AZ, 85289	0.82	Two-digit birth year Phone reformatted Whitespace trimmed
CLM-422257	CLM	Christina Payne	—	—	4604242324	6552 Baseline Rd, Denver, CO, 80209	0.82	Date of birth missing Phone reformatted City re-cased
CLM-416581	CLM	Mason Raamirez	1988-07-17	—	9699818355	7429 Bayshore Dr, Jacksonville, FL, 32296	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-416580	CLM	Mason Raamirez	1988-07-17	—	9699818355	7429 Bayshore Dr, Jacksonville, FL, 32296	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-430566	CLM	Logan Greene	1941-01-16	—	6095528497	8341 Market St, Glendale, AZ, 85355	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-414288	CLM	Raymond Lawrence	1949-08-08	—	7416800946	9838 Canyon Rd, Seattle, WA	0.82	Phone reformatted ZIP missing Placeholder values cleared
CLM-401188	CLM	Megan Pena	1981-12-16	UHC-82997-21	3972090847	—	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-424996	CLM	Marilyn Berry	1982-05-02	UHC-72413-38	5068142068	3353 Mesa Dr, Sacramento, CA, 95860	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
CLM-404398	CLM	Samantha Castillo	1972-09-18	UHC-23757-47	4294026965	398 Meadow Ln, Atlanta, GA, 30302	0.82	Phone reformatted ZIP+4 trimmed Placeholder values cleared
CLM-412740	CLM	Harold P Patterson	1940-03-26	UHC-04603-36	3754075325	—	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
CLM-408492	CLM	Donna N Allen	—	UHC-09329-72	8384274365	8751 Bayshore Dr, Charlotte, NC, 28299	0.82	Date of birth missing Phone reformatted Placeholder values cleared
CLM-410284	CLM	Kenneth Coleman	1949-02-20	UHC-07479-77	4217988956	7743 River Rd, Los Angeles, CA, 90010	0.82	Phone reformatted State name converted to code Placeholder values cleared
CLM-424052	CLM	Kim Gibson	2004-07-23	UHC-59029-58	8095436886	3019 Mesa Dr, Houston, TX, 77092	0.84	Name split from “Last, First”Phone reformatted
CLM-401626	CLM	Melissa D Vasquez	1998-05-26	UHC-30778-66	7055224240	—	0.84	Name split from “Last, First”Phone reformatted
CLM-416537	CLM	Valentina Aguilar	1942-05-19	UHC-88614-93	2386095322	4653 River Rd, Glendale, AZ, 85376	0.84	Phone reformatted State name converted to code
CLM-428329	CLM	Jerry E Willis	1987-02-05	UHC-50882-93	3374446135	2637 River Rd, Plano, TX, 75053	0.84	Phone reformatted ZIP+4 trimmed
CLM-417054	CLM	Roger Wagner	1959-01-11	—	6535995616	—	0.84	Name split from “Last, First”Phone reformatted
CLM-426273	CLM	Rtuh Dixon	1938-07-22	UHC-79049-36	9319270788	4358 Park Pl, Glendale, AZ, 85349	0.84	Name split from “Last, First”Phone reformatted
CLM-432045	CLM	Nicole Arnold	1954-06-26	UHC-07442-46	9375571813	—	0.84	Phone reformatted Gender normalised
CLM-411045	CLM	Mei Hudson	1961-05-03	UHC-21510-91	2546809363	6252 Ocean Ave, Tampa, FL, 33610	0.84	Two-digit birth year Phone reformatted
CLM-411046	CLM	Mei Hudson	1961-05-03	UHC-21510-91	2546809363	6252 Ocean Ave, Tampa, FL, 33610	0.84	Two-digit birth year Phone reformatted
CLM-430695	CLM	Linda Banks	1959-12-08	—	8714636087	9484 River Rd, San Antonio, TX	0.84	Phone reformatted ZIP missing
CLM-420722	CLM	Barbara Adams	1965-10-03	UHC-39914-52	5533683724	—	0.84	Two-digit birth year Phone reformatted
CLM-422565	CLM	Dylan Raid	1943-12-05	UHC-30535-48	6455474498	2056 Mesa Dr, Plano, TX, 75058	0.84	Name split from “Last, First”Phone reformatted
CLM-423109	CLM	Emily Little	1996-04-14	UHC-12266-19	7375403603	—	0.84	Phone reformatted Gender normalised
CLM-422927	CLM	—Junk	1997-02-09	—	9826972447	—	0.84	Phone reformatted No usable name (quarantined)
CLM-401124	CLM	Alexis Harper	1954-04-02	UHC-57014-87	9049731226	1582 Sage Ct, Eden Prairie, MN, 55310	0.84	Phone reformatted State name converted to code
CLM-431581	CLM	Sarah Cook	2000-11-01	—	5643981115	—	0.84	Phone reformatted Gender normalised
CLM-427379	CLM	Roger Davis	1994-04-28	UHC-30457-09	2114195514	4491 Elm St, Miami, FL, 33168	0.84	Phone reformatted State name converted to code
CLM-410176	CLM	Christine Morales	2007-01-19	UHC-18121-75	5674677874	9879 Lincoln Way, Fresno, CA, 93702	0.86	Name re-cased Date of birth reformatted Phone reformatted Member ID reformatted+3 more
CLM-412174	CLM	Tran B Maria	1969-05-10	UHC-71683-43	4302044410	8644 Broadway, Chandler, AZ, 85246	0.86	Name re-cased Date of birth reformatted Phone reformatted City re-cased+3 more
CLM-412603	CLM	Lori Cmapbell	1980-01-13	UHC-28401-72	5544397034	231 Broadway, Fresno, CA, 93734	0.86	Name re-cased Date of birth reformatted Phone reformatted Address re-cased+3 more
CLM-416977	CLM	Mark Contreras	1994-06-05	UHC-18319-57	3653359957	7677 Indian School Rd, Sacramento, CA, 95831	0.86	Name re-cased Date of birth reformatted Phone reformatted Member ID reformatted+3 more
CLM-414627	CLM	Kathleen Andrews	1960-05-22	UHC-09149-87	3092080763	4573 Baseline Rd, Phoenix, AZ, 85036	0.86	Name re-cased Date of birth reformatted Phone reformatted State code upper-cased+3 more
CLM-420008	CLM	Patricia Z Dixon	1980-05-05	UHC-19955-99	8944666462	4078 Elm St, Charlotte, NC, 28210	0.86	Name re-cased Date of birth reformatted Phone reformatted Member ID reformatted+3 more
CLM-420570	CLM	Linda McDonald	1980-04-09	UHC-70228-56	6556550558	6056 Highland Ave, Atlanta, GA, 30385	0.86	Name re-cased Date of birth reformatted Phone reformatted City re-cased+3 more
CLM-425457	CLM	Edward Reyes	2004-09-24	UHC-07461-95	5445091423	—	0.86	Name re-cased Date of birth reformatted Phone reformatted Member ID reformatted+3 more
CLM-421318	CLM	Jennifer Weber	1946-07-05	UHC-83139-76	9197241137	—	0.88	Name re-cased Date of birth reformatted Phone reformatted Email lower-cased+2 more

11,960 rows, page 175 of 240Previous Next