Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Street suffix standardised”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagStreet suffix standardisedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-427647	CLM	Sofia Arnold	1973-09-13	—	6218378889	423 Market St, Sacramento, CA, 95843	0.66	Date of birth reformatted Street suffix standardised Address re-cased ZIP+4 trimmed+1 more
CLM-404263	CLM	Lucia Hoffman	1940-02-12	UHC-31201-99	3569658725	836 Desert Sky Blvd, Seattle, WA, 98195	0.66	Street suffix standardised Address re-cased State name converted to code Whitespace trimmed+1 more
CLM-419797	CLM	Tyler I Rice	1994-08-12	UHC-71226-29	—	9763 Spring St, Orlando, FL, 32855	0.66	Name split from “Last, First”Street suffix standardised Address re-cased Whitespace trimmed+1 more
CLM-404797	CLM	Alice Perry	—	UHC-53984-35	2096714901	9138 Harbor Blvd, Denver, CO, 80219	0.66	Date of birth unreadable Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-423782	CLM	Sam Andrews	2009-11-08	—	—	7446 Washington St, Las Vegas, NV, 89129	0.66	Name re-cased Street suffix standardised Address re-cased State name converted to code+1 more
CLM-429341	CLM	Eric Gonzales	2001-08-13	UHC-63564-60	—	2240 Park Pl, Mesa, AZ, 85226	0.66	Street suffix standardised Address re-cased Gender normalised Whitespace trimmed+1 more
CLM-408055	CLM	Ruth Harper	1949-07-03	UHC-27779-17	—	2411 Mesa Dr, Miami, FL, 33165	0.66	Member ID reformatted Street suffix standardised Address re-cased State name converted to code+1 more
CLM-407807	CLM	Samantha Morris	1995-01-25	UHC-43300-11	—	921 Church St, Tucson, AZ, 85776	0.66	Street suffix standardised Address re-cased State code upper-cased Gender normalised+1 more
CLM-415296	CLM	Brandon Watson	1999-08-03	UHC-65481-98	—	3953 River Rd, Fresno, CA, 93756	0.66	Two-digit birth year Street suffix standardised Address re-cased Whitespace trimmed+1 more
CLM-417343	CLM	Kimberly Austin	1999-02-22	—	9814286798	1735 Church St, Charlotte, NC, 28268	0.66	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+1 more
CLM-427094	CLM	Joan Ross	1959-10-25	UHC-79586-26	9263764800	1875 Elm St, Sacramento, CA, 95822	0.66	Name re-cased Street suffix standardised Address re-cased ZIP+4 trimmed+1 more
CLM-404667	CLM	Margaret Smith	1976-01-15	UHC-25071-63	—	1446 Ridge Rd, Chandler, AZ, 85248	0.66	Date of birth reformatted Street suffix standardised Address re-cased ZIP+4 trimmed+1 more
CLM-413082	CLM	Yuki Maldonado	1942-09-18	—	7058650740	9197 Baseline Rd, Jacksonville, FL, 32209	0.66	Phone reformatted Street suffix standardised Address re-cased Gender normalised+1 more
CLM-426462	CLM	Martha Q Soto	—	—	—	1011 Lincoln Way, Glendale, AZ, 85337	0.66	Date of birth unreadable Street suffix standardised Address re-cased City re-cased+1 more
CLM-406147	CLM	Joyce Griffin	1968-07-25	UHC-02702-65	—	6425 Ocean Ave, Tampa, FL, 33676	0.66	Date of birth reformatted Street suffix standardised Address re-cased Gender normalised+1 more
CLM-413209	CLM	Jordan Walsh	1982-05-11	UHC-64695-37	—	8634 Church St, San Diego, CA, 92132	0.66	Date of birth reformatted Street suffix standardised Address re-cased Gender normalised+1 more
CLM-407719	CLM	Natalie Wallace	1940-08-15	UHC-21792-24	—	406 Church St, Sacramento, CA, 95856	0.66	Date of birth reformatted Street suffix standardised Address re-cased ZIP+4 trimmed+1 more
CLM-401701	CLM	Jack C Estrada	1991-01-14	—	9288505242	3522 Market St, Miami, FL, 33185	0.66	Name re-cased Street suffix standardised Address re-cased State name converted to code+1 more
CLM-431289	CLM	Roy U Ortiz	1995-04-07	UHC-61154-15	7566682215	6507 Bayshore Dr, Austin, TX, 78737	0.66	Two-digit birth year Street suffix standardised Address re-cased Email lower-cased+1 more
CLM-413997	CLM	Chris M Stevens	1994-08-02	UHC-11824-83	—	167 Hillcrest Rd, Austin, TX, 78749	0.66	Date of birth reformatted Street suffix standardised Address re-cased Gender normalised+1 more
CLM-403347	CLM	Sofia C Vargas	1954-02-16	—	5342142508	2814 Central Ave, Tucson, AZ, 85706	0.66	Phone reformatted Street suffix standardised Address re-cased ZIP+4 trimmed+1 more
CLM-414470	CLM	Cynthia Perkins	1972-09-09	UHC-19178-80	—	6645 Highland Ave, Denver, CO, 80202	0.66	Two-digit birth year Street suffix standardised Address re-cased City re-cased+1 more
CLM-417568	CLM	Don Richardson	2000-06-11	UHC-97967-62	8257048794	3305 Valley View Dr, Tampa, FL, 33682	0.66	Street suffix standardised Address re-cased Gender normalised Whitespace trimmed+1 more
CLM-418168	CLM	Ronald Hoffman	1979-03-11	UHC-79889-87	—	5161 Elm St, Scottsdale, AZ, 85215	0.66	Street suffix standardised Address re-cased State name converted to code Whitespace trimmed+1 more
CLM-405961	CLM	Judy Wells	1938-01-11	UHC-84471-03	—	9036 Valley View Dr, Tempe, AZ, 85211	0.66	Street suffix standardised Address re-cased State name converted to code Whitespace trimmed+1 more
CLM-424923	CLM	Bobby Carroll	1953-10-03	UHC-95688-41	—	5749 Mountain View Dr Apt 37, Charlotte, NC, 28293	0.66	Unit split from street Street suffix standardised Address re-cased City re-cased+1 more
CLM-430959	CLM	Amber Diaz	1955-11-26	UHC-29467-25	—	5873 Central Ave, Dallas, TX, 75273	0.66	Name re-cased Street suffix standardised Address re-cased ZIP+4 trimmed+1 more
CLM-413362	CLM	Ashley N Griffin	1996-03-05	—	—	7288 Market St, Houston, TX, 77062	0.66	Street suffix standardised Address re-cased City re-cased Gender normalised+1 more
CLM-413759	CLM	George H Reynolds	1989-10-21	—	5128949093	7003 Valley View Dr, Glendale, AZ, 85329	0.66	Phone reformatted Street suffix standardised Address re-cased Gender normalised+1 more
CLM-410813	CLM	Arjun Russell	1978-03-14	UHC-27441-79	—	3080 Palm Dr, Sacramento, CA, 95858	0.66	Name re-cased Street suffix standardised Address re-cased Gender normalised+1 more
CLM-415451	CLM	Jacqueline Young	1969-01-27	UHC-67667-24	—	5905 Maple Ave, Glendale, AZ, 85348	0.66	Name re-cased Street suffix standardised Address re-cased ZIP+4 trimmed+1 more
CLM-424380	CLM	Nicole Bryant	1973-03-24	UHC-87960-16	4186686351	8509 Valley View Dr, Dallas, TX, 75208	0.66	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-414792	CLM	Scott Ward	—	UHC-40403-01	9702470172	468 Pine Dr, Jacksonville, FL, 32251	0.66	Date of birth unreadable Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-403106	CLM	Ethan Stevens	1961-05-25	UHC-83036-06	—	7486 River Rd, Dallas, TX	0.66	Name re-cased Street suffix standardised Address re-cased ZIP missing+1 more
CLM-419113	CLM	Jacqueline Nelosn	1956-08-17	UHC-14047-09	—	9235 Jefferson Ave, Los Angeles, CA, 90026	0.66	Date of birth reformatted Street suffix standardised Address re-cased State name converted to code+1 more
CLM-402390	CLM	Linda Ryan	1952-06-11	—	6655572730	3595 Elm St, Scottsdale, AZ, 85297	0.66	Street suffix standardised Address re-cased Gender normalised Whitespace trimmed+1 more
CLM-415223	CLM	Philip A Gant	1990-09-27	UHC-64888-16	—	5762 Main St, Mesa, AZ, 85227	0.66	SSN last four extracted Street suffix standardised Address re-cased Whitespace trimmed+1 more
CLM-412716	CLM	Amy Hawins	1967-04-16	UHC-23477-69	7077472918	1162 Grand Ave, Minneapolis, MN, 55406	0.66	Phone reformatted Street suffix standardised Address re-cased Gender normalised+1 more
CLM-412715	CLM	Amy Hawins	1967-04-16	UHC-23477-69	7077472918	1162 Grand Ave, Minneapolis, MN, 55406	0.66	Phone reformatted Street suffix standardised Address re-cased Gender normalised+1 more
CLM-408698	CLM	Shirley Hunt	1958-09-01	UHC-53979-10	5092460501	1390 Indian School Rd, Fresno, CA, 93789	0.66	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-424037	CLM	Jerry Martin	1994-11-16	UHC-95865-44	3293310200	9420 Baseline Rd, Houston, TX, 77025	0.66	Two-digit birth year Street suffix standardised Address re-cased Whitespace trimmed+1 more
CLM-410722	CLM	Ralph Buurns	1962-07-13	UHC-48557-35	2276157714	679 Palm Dr, Jacksonville, FL, 32214	0.66	Phone reformatted Street suffix standardised Address re-cased Gender normalised+1 more
CLM-410376	CLM	Arujn Larson	1991-01-24	UHC-89929-24	9854405454	1443 Mesa Dr, Plano, TX, 75059	0.66	Name split from “Last, First”Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-424759	CLM	Thomas Matthews	2005-09-23	UHC-54543-72	7982542444	6278 Central Ave, Nashville, TN	0.66	Street suffix standardised Address re-cased State code upper-cased ZIP missing+1 more
CLM-430417	CLM	Valentina Guerrero	1977-09-18	—	—	7765 Grand Ave, Columbus, OH, 43232	0.66	Street suffix standardised Address re-cased City re-cased State name converted to code+1 more
CLM-406045	CLM	Nicole Sullivan	2005-09-21	UHC-05239-58	—	5598 Valley View Dr, Tempe, AZ, 85235	0.66	Phone missing area code Street suffix standardised Address re-cased Whitespace trimmed+1 more
CLM-402495	CLM	Evelyn P Fisher	2005-10-08	UHC-52353-84	—	489 Highland Ave, Sacramento, CA, 95826	0.66	Name re-cased Street suffix standardised Address re-cased State name converted to code+1 more
CLM-417552	CLM	Albert Cruz	1992-04-19	—	—	8046 Camelback Rd, Seattle, WA, 98137	0.66	Date of birth reformatted Phone missing area code Street suffix standardised Address re-cased+1 more
CLM-418125	CLM	Donald Weber	1977-01-24	UHC-71132-52	8047608422	4064 Indian School Rd, Minneapolis, MN, 55460	0.66	Name split from “Last, First”Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-423695	CLM	Fatima Bell	1997-02-17	—	3783962460	3325 Harbor Blvd, Miami, FL, 33179	0.66	Phone reformatted Street suffix standardised Address re-cased State name converted to code+1 more

16,411 rows, page 167 of 329Previous Next