Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Two-digit birth year”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagTwo-digit birth yearClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-431726	CLM	Ahmed Sims	1972-07-07	UHC-36382-81	—	7759 Harbor Blvd, Dallas, TX, 75257	0.54	Two-digit birth year Street suffix standardised Address re-cased Gender normalised+1 more
CLM-428409	CLM	Nancy Rojas	2007-10-03	UHC-59612-31	8799502293	309 Ocean Ave, Austin, TX, 78700	0.54	Two-digit birth year Street suffix standardised Address re-cased State name converted to code+1 more
CLM-427703	CLM	Jacqueline Mitchell	1984-06-10	—	—	7226 Broadway, Denver, CO, 80223	0.54	Name split from “Last, First”Two-digit birth year Address re-cased Gender normalised+1 more
CLM-415798	CLM	Joe Diaz	2001-03-25	—	—	3111 Maple Ave, Glendale, AZ	0.54	Two-digit birth year ZIP missing Gender normalised Whitespace trimmed+1 more
CLM-406596	CLM	Hiroshi Lewis	1954-09-13	—	—	3962 Main St, Scottsdale, AZ	0.54	Name split from “Last, First”Two-digit birth year ZIP missing Whitespace trimmed+1 more
CLM-406093	CLM	Amber Valdez	1954-09-28	UHC-35139-26	7809788208	7773 Highland Ave, Miami, FL, 33103	0.54	Name split from “Last, First”Two-digit birth year Phone reformatted State name converted to code+1 more
CLM-407074	CLM	Angela Sanders	1975-04-10	—	—	2301 Grand Ave, Jacksonville, FL, 32217	0.54	Two-digit birth year Street suffix standardised Address re-cased State name converted to code+1 more
CLM-407888	CLM	Rebecca F Hughes	1982-04-18	UHC-55608-51	—	6044 Palm Dr, San Diego, CA, 92170	0.54	Two-digit birth year State name converted to code Gender normalised Whitespace trimmed+1 more
CLM-431582	CLM	Aaron Morris	1945-05-07	—	—	6297 Lake View Rd # 445, Scottsdale, AZ, 85276	0.54	Name re-cased Two-digit birth year Unit split from street ZIP+4 trimmed+1 more
CLM-430254	CLM	Shirley Brooks	1980-12-17	UHC-51174-59	—	9743 Sage Ct, San Diego, CA, 92119	0.54	Name split from “Last, First”Two-digit birth year Street suffix standardised Address re-cased+1 more
CLM-425122	CLM	Samantha Lawrence	1940-04-12	UHC-39266-73	—	7120 Washington St, Tucson, AZ	0.54	Two-digit birth year Street suffix standardised Address re-cased ZIP missing+1 more
CLM-432461	CLM	Martha Z Williamson	1995-08-06	UHC-86118-06	—	364 Broadway # 411, Plano, TX, 75094	0.54	Two-digit birth year Phone missing area code Unit split from street Whitespace trimmed+1 more
CLM-417410	CLM	Robert M Soto	1978-02-19	—	5966517237	1690 Church St, Miami, FL, 33132	0.54	Name split from “Last, First”Two-digit birth year Street suffix standardised Address re-cased+1 more
CLM-400905	CLM	Adam Walsh	1956-08-01	UHC-75549-63	6756220001	6706 Lincoln Way, Denver, CO, 80221	0.56	Two-digit birth year State name converted to code Gender normalised Whitespace trimmed
CLM-429646	CLM	Megan Garrett	1944-02-14	UHC-79469-26	—	3207 Cedar Ln, Los Angeles, CA, 90037	0.56	Name split from “Last, First”Two-digit birth year Gender normalised Placeholder values cleared
CLM-412075	CLM	Russell Williamson	1947-11-06	UHC-57475-82	—	1151 Maple Ave # 756, Miami, FL, 33120	0.56	Two-digit birth year Unit split from street Gender normalised Placeholder values cleared
CLM-409242	CLM	Hannah Oliver	1951-07-08	UHC-60027-75	—	926 Oak St, Scottsdale, AZ	0.56	Two-digit birth year Street suffix standardised Address re-cased ZIP missing
CLM-413028	CLM	Peterson Marilyn	1942-12-11	UHC-78588-21	—	2853 River Rd, Phoenix, AZ, 85070	0.56	Name split from “Last, First”Two-digit birth year Gender normalised Placeholder values cleared
CLM-407083	CLM	Bryan Carter	1973-11-26	—	3859541310	2538 Valley View Dr, Austin, TX, 78720	0.56	Two-digit birth year Phone reformatted ZIP+4 trimmed Gender normalised
CLM-413270	CLM	Grace S Maldonado	1945-01-19	UHC-96133-18	—	902 Lincoln Way, Orlando, FL, 32827	0.56	Two-digit birth year SSN last four extracted Gender normalised Placeholder values cleared
CLM-422923	CLM	Jennifer Burton	1969-06-02	UHC-57790-33	—	7210 Ocean Ave, Gilbert, AZ, 85230	0.56	Two-digit birth year Phone missing area code ZIP+4 trimmed Placeholder values cleared
CLM-426616	CLM	Beverly Morris	1960-03-26	—	4229718925	502 Mesa Dr, Mesa, AZ, 85220	0.56	Two-digit birth year Street suffix standardised Address re-cased Gender normalised
CLM-419177	CLM	Marilyn Barnes	1957-12-23	UHC-48806-49	—	4785 Apache Blvd, San Diego, CA, 92164	0.56	Two-digit birth year Street suffix standardised Address re-cased State name converted to code
CLM-405162	CLM	George Franklin	1964-06-09	UHC-98768-47	—	4658 Indian School Rd, San Diego, CA, 92133	0.56	Two-digit birth year Phone missing area code Street suffix standardised Address re-cased
CLM-426251	CLM	Paul W Nguyen	1940-12-21	UHC-22208-52	—	—	0.56	Two-digit birth year SSN last four extracted Gender normalised Placeholder values cleared
CLM-431152	CLM	Jordan Munoz	2007-05-27	—	—	4852 Mountain View Dr, Mesa, AZ, 85211	0.56	Name split from “Last, First”Two-digit birth year ZIP+4 trimmed Placeholder values cleared
CLM-420412	CLM	Jason Espinoza	1959-09-06	UHC-11220-61	—	7502 Central Ave, Miami, FL, 33109	0.56	Name split from “Last, First”Two-digit birth year State name converted to code Placeholder values cleared
CLM-419048	CLM	David Yang	1991-09-02	—	—	—	0.56	Name split from “Last, First”Two-digit birth year Gender normalised Placeholder values cleared
CLM-421115	CLM	Kathryn Gutierrez	2000-11-17	UHC-77738-19	2853333842	1505 Palm Dr, Austin, TX, 78744	0.56	Name split from “Last, First”Two-digit birth year Street suffix standardised Address re-cased
CLM-404140	CLM	Willie Schmidt	1942-05-12	UHC-28576-15	—	446 Maple Ave, Houston, TX, 77030	0.56	Name split from “Last, First”Two-digit birth year State name converted to code Placeholder values cleared
CLM-405686	CLM	Jerry Lynch	1978-12-27	UHC-81730-62	—	5218 Broadway Apt 32, Miami, FL, 33112	0.56	Two-digit birth year Unit split from street ZIP+4 trimmed Placeholder values cleared
CLM-423308	CLM	Justin S Tucker	1968-12-26	—	—	7759 Forest Ave, Denver, CO, 80231	0.56	Two-digit birth year State name converted to code Gender normalised Placeholder values cleared
CLM-423801	CLM	Doris P King	1976-07-06	UHC-76651-46	—	1377 Indian School Rd, Tampa, FL	0.56	Two-digit birth year State name converted to code ZIP missing Placeholder values cleared
CLM-417598	CLM	Jason Garrett	1978-04-08	UHC-04664-80	—	7286 Baseline Rd, Phoenix, AZ, 85081	0.56	Two-digit birth year Phone missing area code Gender normalised Placeholder values cleared
CLM-405926	CLM	Vaalentina Knight	1972-03-19	UHC-33721-28	9385331839	8232 Elm St, Miami, FL, 33166	0.58	Name re-cased Two-digit birth year Phone reformatted Member ID reformatted+5 more
CLM-430092	CLM	Yuki Spencer	1939-06-28	UHC-90438-72	—	1176 Ocean Ave, Miami, FL, 33186	0.58	Name split from “Last, First”Two-digit birth year State name converted to code
CLM-423884	CLM	Mason Rios	1980-07-07	UHC-58394-45	7052457259	8660 Central Ave, Houston, TX, 77095	0.58	Name re-cased Two-digit birth year Phone reformatted Member ID reformatted+5 more
CLM-415745	CLM	Nancy Myers	1991-06-05	—	5585585147	5117 Indian School Rd, Minneapolis, MN, 55429	0.58	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+5 more
CLM-410444	CLM	Cynthia Hunter	2007-09-01	UHC-66546-30	7594934343	5520 Elm St, Seattle, WA, 98166	0.60	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+4 more
CLM-410443	CLM	Cynthia Hunter	2007-09-01	UHC-66546-30	7594934343	5520 Elm St, Seattle, WA, 98166	0.60	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+4 more
CLM-412512	CLM	Ana Jenkins	1946-01-22	UHC-83983-70	7778597230	882 Broadway Apt 28, Columbus, OH, 43233	0.60	Name re-cased Two-digit birth year Phone reformatted Unit split from street+4 more
CLM-404970	CLM	Samantha Miller	1940-11-09	UHC-50684-94	—	5308 Grand Ave, Tucson, AZ, 85778	0.60	Name re-cased Two-digit birth year Member ID reformatted Street suffix standardised+4 more
CLM-405266	CLM	Emma Willis	1954-08-24	UHC-58209-41	3946726890	2532 Grand Ave, Austin, TX, 78758	0.60	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+4 more
CLM-421131	CLM	Hannah Hoffman	1951-10-12	UHC-41519-61	6418214518	2300 Elm St, Orlando, FL, 32879	0.60	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+4 more
CLM-428227	CLM	Joan B Vazquez	1958-10-06	UHC-66979-80	3959648074	2813 Valley View Dr, Chandler, AZ, 85283	0.60	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+4 more
CLM-431687	CLM	Andrew Q Marshall	1982-04-17	UHC-95340-43	7443086912	6828 Meadow Ln, San Diego, CA, 92120	0.60	Name re-cased Two-digit birth year Phone reformatted Member ID reformatted+4 more
CLM-421824	CLM	Jeffrey Green	1958-05-12	UHC-73338-83	—	6830 Church St, Columbus, OH, 43229	0.60	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+4 more
CLM-419302	CLM	Adam Wheeler	1950-10-17	—	7826026135	3569 Jefferson Ave, Houston, TX, 77056	0.60	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+4 more
CLM-426497	CLM	Paul Marshall	1962-10-12	UHC-10623-89	5663160388	980 Central Ave, Atlanta, GA, 30388	0.60	Name re-cased Two-digit birth year Phone reformatted Member ID reformatted+4 more
CLM-417541	CLM	Susan Perkins	1992-07-11	UHC-70290-70	6397383695	1937 Central Ave, Tempe, AZ, 85289	0.60	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+4 more

2,168 rows, page 13 of 44Previous Next