Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Street suffix standardised”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagStreet suffix standardisedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-424868	CLM	Hiroshi Brooks	1990-08-15	UHC-65032-33	4385737130	2677 Washington St, Mesa, AZ	0.50	Name split from “Last, First”Date of birth reformatted Phone reformatted Street suffix standardised+3 more
CLM-423629	CLM	Joan Knight	1997-11-15	UHC-05751-15	9414703845	3802 Highland Ave, Fresno, CA, 93796	0.50	Name split from “Last, First”Phone reformatted SSN last four extracted Street suffix standardised+3 more
CLM-422993	CLM	Betty G Gomez	1977-06-09	—	3774138090	347 Main St, Tampa, FL, 33632	0.50	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+3 more
CLM-423634	CLM	Carol M Franklin	1938-04-22	UHC-98866-30	—	8103 Union St, Tempe, AZ, 85292	0.50	Name split from “Last, First”Street suffix standardised Address re-cased State code upper-cased+3 more
CLM-426792	CLM	Scott Vazquez	1997-04-28	UHC-50406-76	3305732909	7201 Sunset Blvd, Charlotte, NC, 28225	0.50	Name split from “Last, First”Date of birth reformatted Street suffix standardised Address re-cased+3 more
CLM-426791	CLM	Scott Vazquez	1997-04-28	UHC-50406-76	3305732909	7201 Sunset Blvd, Charlotte, NC, 28225	0.50	Name split from “Last, First”Date of birth reformatted Street suffix standardised Address re-cased+3 more
CLM-407023	CLM	Ruth Weaver	1986-01-08	UHC-27012-03	—	7988 Mesa Dr Apt 4, San Antonio, TX	0.50	Date of birth reformatted Unit split from street Street suffix standardised Address re-cased+3 more
CLM-424854	CLM	Thomas Butler	—	UHC-27322-96	2342784349	7572 Central Ave, Scottsdale, AZ, 85242	0.50	Name split from “Last, First”Date of birth unreadable Phone reformatted Street suffix standardised+3 more
CLM-411426	CLM	Tim Rice	1953-04-19	—	9814006920	7553 Desert Sky Blvd, Tucson, AZ, 85723	0.50	Name split from “Last, First”SSN last four extracted Street suffix standardised Address re-cased+3 more
CLM-429063	CLM	Michael Mills	1996-08-15	—	—	1624 Mountain View Dr Apt 5, Nashville, TN, 37273	0.50	Date of birth reformatted Unit split from street Street suffix standardised Address re-cased+3 more
CLM-408448	CLM	Joshua Walsh	1988-08-25	UHC-33244-92	—	3529 Union St # 381, Eden Prairie, MN, 55349	0.50	Name re-cased SSN last four extracted Unit split from street Street suffix standardised+3 more
CLM-404482	CLM	Maria Fields	2000-02-10	—	4563813806	9137 Ocean Ave, Sacramento, CA, 95838	0.50	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+3 more
CLM-418056	CLM	Brittany W Nunez	2006-06-06	UHC-13686-89	5748079358	2966 Cedar Ln, Seattle, WA, 98195	0.50	Name split from “Last, First”Date of birth reformatted Phone reformatted Street suffix standardised+3 more
CLM-405960	CLM	Judy P Wells	1938-01-11	UHC-84471-03	2872005196	9036 Valley View Dr, Tempe, AZ, 85211	0.50	Name re-cased Phone reformatted SSN last four extracted Street suffix standardised+3 more
CLM-432583	CLM	Mateo Caarlson	1937-10-22	—	5974108821	805 Ocean Ave, Atlanta, GA, 30382	0.50	Name split from “Last, First”Phone reformatted Street suffix standardised Address re-cased+3 more
CLM-401606	CLM	Martha Simmons	2002-02-09	—	—	1191 Park Pl # 792, Atlanta, GA, 30306	0.50	Name split from “Last, First”Date of birth reformatted Unit split from street Street suffix standardised+3 more
CLM-407003	CLM	Grace Lawrence	1990-02-28	UHC-55097-42	—	5929 Central Ave, Glendale, AZ	0.50	Name re-cased Date of birth reformatted Street suffix standardised Address re-cased+3 more
CLM-432319	CLM	Justin Powell	1983-02-13	UHC-42263-27	—	2150 Spring St, Columbus, OH, 43255	0.50	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+3 more
CLM-412069	CLM	Ruth Dunn	2002-12-22	—	—	1310 Apache Blvd, Tampa, FL, 33623	0.50	Name split from “Last, First”Street suffix standardised Address re-cased State code upper-cased+3 more
CLM-406629	CLM	William Howard	1946-05-27	—	6322157771	9694 Bayshore Dr, Nashville, TN, 37277	0.50	Name split from “Last, First”Phone reformatted Street suffix standardised Address re-cased+3 more
CLM-402399	CLM	Beth Jimenez	1945-05-25	UHC-65211-83	—	8362 Hillcrest Rd # 155, Columbus, OH	0.50	Name re-cased Unit split from street Street suffix standardised Address re-cased+3 more
CLM-408511	CLM	Bobby I Dominguez	2005-12-21	UHC-26590-88	—	1263 Canyon Rd Apt 7, Dallas, TX, 75265	0.50	Date of birth reformatted Unit split from street Street suffix standardised Address re-cased+3 more
CLM-410849	CLM	Charlotte Kennedy	2008-05-19	—	2273003289	1168 Apache Blvd, San Diego, CA, 92146	0.50	Name split from “Last, First”Two-digit birth year Phone reformatted Street suffix standardised+3 more
CLM-421557	CLM	Donald Stewart	—	—	—	5415 Highland Ave, Minneapolis, MN, 55498	0.50	Date of birth unreadable Street suffix standardised Address re-cased City re-cased+3 more
CLM-422632	CLM	Heather Hudson	1938-03-05	—	9293965350	359 Jefferson Ave, Fresno, CA, 93771	0.50	Phone reformatted Street suffix standardised Address re-cased State name converted to code+3 more
CLM-426350	CLM	Maria R Jordan	1979-04-01	—	—	7536 Central Ave, Atlanta, GA, 30385	0.50	Name re-cased Street suffix standardised Address re-cased State name converted to code+3 more
CLM-432163	CLM	Jordan Thoomas	1948-03-05	UHC-00688-86	—	5317 Jefferson Ave, Sacramento, CA	0.50	Name re-cased Street suffix standardised Address re-cased ZIP missing+3 more
CLM-421393	CLM	Mason Miller	1955-12-23	UHC-52836-22	—	825 Mountain View Dr, Houston, TX	0.52	Date of birth reformatted Street suffix standardised Address re-cased State name converted to code+2 more
CLM-417906	CLM	Amanda I Fsher	1970-08-21	UHC-11517-28	—	5090 Willow Ct # 378, Phoenix, AZ, 85007	0.52	Name split from “Last, First”Date of birth reformatted Unit split from street Street suffix standardised+2 more
CLM-401956	CLM	Ashley Murphy	1952-10-12	—	—	1854 Oak St, Las Vegas, NV, 89156	0.52	Name split from “Last, First”Street suffix standardised Address re-cased City re-cased+2 more
CLM-407497	CLM	Martha Weaver	1987-08-11	UHC-63216-91	—	7449 Jefferson Ave, Scottsdale, AZ, 85226	0.52	Name split from “Last, First”Street suffix standardised Address re-cased ZIP+4 trimmed+2 more
CLM-424698	CLM	Ronald Valdez	1978-10-18	UHC-61056-55	7287468816	9019 Central Ave, Jacksonville, FL, 32234	0.52	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+2 more
CLM-416196	CLM	Carol Dunn	1959-09-09	UHC-98857-51	—	5140 Apache Blvd, Fresno, CA, 93731	0.52	Two-digit birth year Street suffix standardised Address re-cased State name converted to code+2 more
CLM-429152	CLM	Susan Hanson	1982-10-01	UHC-29460-45	2715230271	4755 Maple Ave Apt 23, Minneapolis, MN, 55488	0.52	Name split from “Last, First”Unit split from street Street suffix standardised Address re-cased+2 more
CLM-428027	CLM	Carl Russell	1970-11-28	UHC-40882-68	—	3970 Palm Dr, Dallas, TX, 75204	0.52	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+2 more
CLM-412842	CLM	George P Evans	1942-02-04	UHC-58786-71	8625600336	4569 Mesa Dr, Scottsdale, AZ, 85296	0.52	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+2 more
CLM-418020	CLM	Jessica Gordon	—	—	—	7519 Pine Dr, Sacramento, CA, 95810	0.52	Date of birth missing Street suffix standardised Address re-cased State name converted to code+2 more
CLM-429084	CLM	Mariena Williamson	1967-04-01	—	4858857683	2955 Church St, Fresno, CA	0.52	Name re-cased Street suffix standardised Address re-cased State name converted to code+2 more
CLM-400624	CLM	Harold E Martin	1989-10-04	—	8902671945	1613 Highland Ave, Seattle, WA, 98125	0.52	Phone reformatted Street suffix standardised Address re-cased ZIP+4 trimmed+2 more
CLM-413734	CLM	Frank Austni	1964-07-03	UHC-35904-15	—	93 Oak St Apt 26, Austin, TX, 78751	0.52	Two-digit birth year Unit split from street Street suffix standardised Address re-cased+2 more
CLM-400880	CLM	Janet Wright	1966-09-20	UHC-45348-02	—	4019 Maple Ave, Minneapolis, MN, 55415	0.52	Name split from “Last, First”Two-digit birth year Street suffix standardised Address re-cased+2 more
CLM-407177	CLM	Ahmed T Wallace	1970-07-11	—	—	4100 Cedar Ln, Scottsdale, AZ	0.52	Street suffix standardised Address re-cased State name converted to code ZIP missing+2 more
CLM-424065	CLM	Patricia Ross	1949-05-22	UHC-68744-18	—	52 Desert Sky Blvd, Glendale, AZ, 85394	0.52	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+2 more
CLM-430815	CLM	Diego Montgomery	1950-06-08	—	—	2865 Main St, Columbus, OH, 43211	0.52	Two-digit birth year Street suffix standardised Address re-cased State name converted to code+2 more
CLM-419539	CLM	Terry Riley	—	UHC-75916-85	—	6634 Union St Apt 4, Seattle, WA, 98178	0.52	Date of birth unreadable Unit split from street Street suffix standardised Address re-cased+2 more
CLM-429105	CLM	Walter Gomez	1945-05-22	UHC-83989-37	5906943061	2117 Camelback Rd, Chandler, AZ, 85299	0.52	Name split from “Last, First”Two-digit birth year Phone reformatted Street suffix standardised+2 more
CLM-430543	CLM	Lauren Ryyan	2006-01-13	—	—	4827 Hillcrest Rd # 940, Mesa, AZ, 85239	0.52	Two-digit birth year Unit split from street Street suffix standardised Address re-cased+2 more
CLM-410806	CLM	Raymond Flores	2007-11-09	UHC-03771-17	5924754300	147 Apache Blvd, Eden Prairie, MN, 55357	0.52	Two-digit birth year Phone reformatted SSN last four extracted Street suffix standardised+2 more
CLM-406325	CLM	Jeremy Ramos	1965-08-26	—	—	674 River Rd Apt 23, Tempe, AZ, 85279	0.52	Name split from “Last, First”Unit split from street Street suffix standardised Address re-cased+2 more
CLM-431912	CLM	Meyer I Omar	1997-04-26	UHC-76229-33	—	6245 Market St # 805, Dallas, TX, 75202	0.52	Name split from “Last, First”Date of birth reformatted Unit split from street Street suffix standardised+2 more

16,411 rows, page 37 of 329Previous Next