Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Plan code upper-cased”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagPlan code upper-casedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-421682	CLM	Gabriel Vasquez	1948-02-04	—	9487201788	6909 Apache Blvd, Minneapolis, MN, 55417	0.78	Phone reformatted Street suffix standardised Address re-cased Plan code upper-cased+1 more
CLM-420657	CLM	Michhael Pyerce	1992-03-04	UHC-60874-56	3454479000	—	0.78	Name split from “Last, First”Phone reformatted Plan code upper-cased Whitespace trimmed+1 more
CLM-427929	CLM	Guerrero Kevin	1956-03-23	UHC-55296-65	—	4927 River Rd, Fresno, CA, 93783	0.78	Street suffix standardised Address re-cased Plan code upper-cased Whitespace trimmed+1 more
CLM-417658	CLM	Carlos McCoy	1981-10-23	—	—	5251 Main St, Tampa, FL, 33640	0.78	Name re-cased Street suffix standardised Address re-cased Plan code upper-cased+1 more
CLM-406384	CLM	Vincent Jenkins	1960-10-26	UHC-91130-49	—	789 Oak St, Tampa, FL	0.78	Name re-cased City re-cased ZIP missing Plan code upper-cased+1 more
CLM-417358	CLM	Billy Edwrds	1985-12-05	UHC-09876-01	—	5729 Camelback Rd, Tempe, AZ	0.78	Name re-cased City re-cased ZIP missing Plan code upper-cased+1 more
CLM-427964	CLM	Hunter Jeff	1974-07-13	—	—	3234 Sage Ct, San Diego, CA, 92176	0.78	Name re-cased Date of birth reformatted Gender normalised Plan code upper-cased+1 more
CLM-424465	CLM	Isabella A Perkins	—	UHC-94647-17	9873461132	—	0.78	Date of birth unreadable Phone reformatted Plan code upper-cased Whitespace trimmed+1 more
CLM-417822	CLM	Aisha B Nguyen	1985-06-09	—	—	6265 Elm St, Chandler, AZ	0.78	Name re-cased ZIP missing Plan code upper-cased Whitespace trimmed+1 more
CLM-426620	CLM	Jeremy Welch	1964-12-19	UHC-21687-55	—	—	0.78	Name re-cased Date of birth reformatted Gender normalised Plan code upper-cased+1 more
CLM-423374	CLM	Amber Lawrence	1978-04-18	UHC-53728-11	—	1461 Bayshore Dr, Fresno, CA, 93794	0.78	Name re-cased Street suffix standardised Address re-cased Plan code upper-cased+1 more
CLM-409455	CLM	Yang Pamela	1945-01-06	UHC-06553-73	—	4873 Market St # 826, Dallas, TX, 75230	0.78	Date of birth reformatted Unit split from street Plan code upper-cased Whitespace trimmed+1 more
CLM-405087	CLM	Janice Cox	1955-09-19	—	—	—	0.78	Date of birth reformatted Gender normalised Plan code upper-cased Whitespace trimmed+1 more
CLM-431368	CLM	Cynthia Martinez	1996-09-25	UHC-73516-61	—	7315 Broadway, Gilbert, AZ, 85227	0.78	Name split from “Last, First”Date of birth reformatted Member ID reformatted Plan code upper-cased+1 more
CLM-430756	CLM	Jerry Knight	1993-08-06	—	5025207306	2251 Forest Ave, Los Angeles, CA	0.78	Phone reformatted ZIP missing Plan code upper-cased Whitespace trimmed+1 more
CLM-422640	CLM	Deborah Willis	1975-02-17	UHC-78282-13	—	2399 Harbor Blvd, Miami, FL, 33157	0.78	Phone missing area code Member ID reformatted Plan code upper-cased Whitespace trimmed+1 more
CLM-419740	CLM	Kathryn Day	1982-11-24	UHC-37330-92	4948845985	6913 River Rd, Charlotte, NC, 28278	0.78	Name re-cased Street suffix standardised Address re-cased Plan code upper-cased+1 more
CLM-416564	CLM	Ana Jackson	1974-07-23	UHC-93432-18	6036832797	1341 Camelback Rd, Glendale, AZ, 85331	0.78	Phone reformatted Street suffix standardised Address re-cased Plan code upper-cased+1 more
CLM-411540	CLM	Betty Rose	2004-02-14	UHC-23050-58	—	1454 Grand Ave, Glendale, AZ, 85332	0.78	Date of birth reformatted Street suffix standardised Address re-cased Plan code upper-cased+1 more
CLM-425283	CLM	Christina Green	1969-11-10	—	—	8203 Jefferson Ave, Glendale, AZ, 85351	0.78	Name re-cased Two-digit birth year City re-cased Plan code upper-cased+1 more
CLM-410574	CLM	Margaret Spencer	1955-02-23	—	2502905224	4242 Baseline Rd, Plano, TX, 75047	0.78	Date of birth reformatted Street suffix standardised Address re-cased Plan code upper-cased+1 more
CLM-424057	CLM	Carl U Bennett	1968-11-07	UHC-25577-22	2173091566	9430 Sage Ct # 789, San Antonio, TX, 78267	0.78	Phone reformatted Unit split from street Plan code upper-cased Whitespace trimmed+1 more
CLM-429170	CLM	Teresa Sims	1970-02-08	UHC-19809-99	—	9686 Indian School Rd, Los Angeles, CA, 90042	0.78	Date of birth reformatted Street suffix standardised Address re-cased Plan code upper-cased+1 more
CLM-403928	CLM	Omar Cunningham	1942-12-28	UHC-84013-63	—	6179 Maple Ave, Jacksonville, FL, 32250	0.78	City re-cased State name converted to code Plan code upper-cased Whitespace trimmed+1 more
CLM-422162	CLM	Amber Coleman	1974-01-06	—	8352715713	6563 Valley View Dr, Jacksonville, FL, 32255	0.78	Phone reformatted Street suffix standardised Address re-cased Plan code upper-cased+1 more
CLM-431137	CLM	Kenneth Ryan	1938-12-17	—	6735033629	—	0.78	Phone reformatted Gender normalised Plan code upper-cased Whitespace trimmed+1 more
CLM-423300	CLM	Sofia Silva	1960-09-16	—	—	7071 Maple Ave, Mesa, AZ, 85288	0.78	Name re-cased Street suffix standardised Address re-cased Plan code upper-cased+1 more
CLM-428880	CLM	Larry Butler	1993-09-21	UHC-48440-51	6504481068	6795 Grand Ave, Orlando, FL, 32826	0.78	Date of birth reformatted Street suffix standardised Address re-cased Plan code upper-cased+1 more
CLM-416899	CLM	Michelle Chavez	1992-04-26	UHC-36979-40	—	5832 Sunset Blvd, Scottsdale, AZ, 85288	0.78	Street suffix standardised Address re-cased Plan code upper-cased Whitespace trimmed+1 more
CLM-404203	CLM	George Lewis	2006-02-23	—	—	2743 Sunset Blvd, Chandler, AZ, 85244	0.78	Street suffix standardised Address re-cased Plan code upper-cased Whitespace trimmed+1 more
CLM-417974	CLM	Douglas Z Gonzales	1991-07-21	UHC-51488-52	7442195854	1017 Apache Blvd, Dallas, TX, 75218	0.78	Phone reformatted Member ID reformatted ZIP+4 trimmed Plan code upper-cased+1 more
CLM-425397	CLM	Omar Castro	1951-12-07	—	—	7219 Oak St, Miami, FL, 33180	0.78	Name re-cased Date of birth reformatted ZIP+4 trimmed Plan code upper-cased+1 more
CLM-425617	CLM	Aaron Nunez	1987-02-13	UHC-75381-08	—	4931 Market St, Tucson, AZ, 85739	0.78	Date of birth reformatted Street suffix standardised Address re-cased Plan code upper-cased+1 more
CLM-408261	CLM	Arthur E Perry	1959-09-11	—	—	9512 Highland Ave, Dallas, TX, 75236	0.78	Name re-cased Street suffix standardised Address re-cased Plan code upper-cased+1 more
CLM-425813	CLM	Jean Day	1943-03-26	UHC-32810-59	2186348777	7726 Church St, Denver, CO, 80220	0.78	Phone reformatted State name converted to code Plan code upper-cased Whitespace trimmed+1 more
CLM-413749	CLM	Gregory Mendez	1947-05-15	—	7043496565	3586 Harbor Blvd, Houston, TX, 77003	0.78	Date of birth reformatted Street suffix standardised Address re-cased City re-cased+1 more
CLM-401781	CLM	Brenda Hoffman	1938-12-27	UHC-56523-95	—	9299 Sunset Blvd, Plano, TX, 75078	0.80	Name split from “Last, First”Plan code upper-cased Whitespace trimmed Placeholder values cleared
CLM-404030	CLM	Martha Bell	1965-09-21	UHC-05322-98	5259835256	1624 Palm Dr, Mesa, AZ, 85222	0.80	Street suffix standardised Address re-cased Plan code upper-cased Whitespace trimmed
CLM-420486	CLM	Jose S Kennedy	1954-07-19	UHC-68721-38	—	312 Harbor Blvd, Denver, CO, 80222	0.80	Date of birth reformatted Gender normalised Plan code upper-cased Placeholder values cleared
CLM-402006	CLM	Pat Knight	2007-09-18	UHC-45826-06	—	—	0.80	Name re-cased Gender normalised Plan code upper-cased Placeholder values cleared
CLM-411395	CLM	Jacob G Kelly	1990-05-14	—	—	9005 Hillcrest Rd, Austin, TX	0.80	Name re-cased ZIP missing Plan code upper-cased Placeholder values cleared
CLM-401462	CLM	Amanda Barnes	1968-07-20	UHC-91250-79	—	—	0.80	Two-digit birth year Plan code upper-cased Whitespace trimmed Placeholder values cleared
CLM-416943	CLM	Dorothy Padilla	1976-02-07	—	—	3193 Lake View Rd, Chandler, AZ, 85297	0.80	Date of birth reformatted Gender normalised Plan code upper-cased Placeholder values cleared
CLM-416260	CLM	Heather Burton	2002-06-15	—	8534239768	308 Central Ave, Miami, FL, 33113	0.80	Phone reformatted Street suffix standardised Address re-cased Plan code upper-cased
CLM-428046	CLM	Roger R Arnold	1998-06-21	—	—	—	0.80	Name split from “Last, First”Plan code upper-cased Whitespace trimmed Placeholder values cleared
CLM-423464	CLM	Amber Willis	1990-08-08	UHC-07211-06	—	—	0.80	Name split from “Last, First”Plan code upper-cased Whitespace trimmed Placeholder values cleared
CLM-401035	CLM	George Hunt	2004-05-18	UHC-97673-28	—	567 Central Ave, San Diego, CA, 92168	0.80	Date of birth reformatted Gender normalised Plan code upper-cased Placeholder values cleared
CLM-429121	CLM	Charlotte Sandoval	1965-09-28	UHC-46215-36	3118574377	—	0.80	Phone reformatted Gender normalised Plan code upper-cased Placeholder values cleared
CLM-408091	CLM	Hiroshi P Burns	1958-03-23	—	4192530938	1047 Lake View Rd, Dallas, TX, 75232	0.80	Phone reformatted Street suffix standardised Address re-cased Plan code upper-cased
CLM-408090	CLM	Hiroshi P Burns	1958-03-23	—	4192530938	1047 Lake View Rd, Dallas, TX, 75232	0.80	Phone reformatted Street suffix standardised Address re-cased Plan code upper-cased

825 rows, page 11 of 17Previous Next