Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Whitespace trimmed”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagWhitespace trimmedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-401515	CLM	Alice Le	1943-01-22	UHC-49554-66	—	845 Bayshore Dr, Charlotte, NC	0.52	Name split from “Last, First”City re-cased ZIP missing Gender normalised+2 more
CLM-428670	CLM	Douglas Patterson	2000-08-26	UHC-20741-40	—	4786 Sage Ct, Los Angeles, CA, 90052	0.52	Name split from “Last, First”Street suffix standardised Address re-cased ZIP+4 trimmed+2 more
CLM-419443	CLM	Joe Bishop	—	UHC-58513-77	—	1154 Forest Ave, Eden Prairie, MN, 55387	0.52	Date of birth unreadable Street suffix standardised Address re-cased State name converted to code+2 more
CLM-405944	CLM	Zachary Harris	1972-03-02	UHC-04428-62	7524419031	6872 Sage Ct # 826, Miami, FL, 33103	0.52	Name re-cased Two-digit birth year Member ID reformatted Unit split from street+2 more
CLM-409728	CLM	Jacob Cooper	1970-12-18	UHC-27394-07	—	9817 Pine Dr, Chandler, AZ, 85257	0.52	Name split from “Last, First”City re-cased ZIP+4 trimmed Gender normalised+2 more
CLM-422210	CLM	Vincent Morgan	1986-08-06	UHC-89453-55	6019759013	6852 Union St # 772, Phoenix, AZ, 85097	0.52	Date of birth reformatted Unit split from street Street suffix standardised Address re-cased+2 more
CLM-406225	CLM	Arthur M Thompson	1941-09-20	UHC-87768-94	7646388935	4865 Elm St, Atlanta, GA, 30373	0.52	Two-digit birth year Street suffix standardised Address re-cased ZIP+4 trimmed+2 more
CLM-423432	CLM	Mei Hoffman	1938-05-02	UHC-76616-84	6563458782	9428 Oak St, Plano, TX, 75031	0.52	Street suffix standardised Address re-cased State name converted to code ZIP+4 trimmed+2 more
CLM-402990	CLM	Gary Cook	1970-06-01	UHC-97450-56	5615335122	6769 Central Ave, Las Vegas, NV, 89148	0.54	Name split from “Last, First”State name converted to code Gender normalised Whitespace trimmed+1 more
CLM-403094	CLM	Ann O Adams	—	UHC-49487-89	9476613565	4774 Broadway # 640, Scottsdale, AZ, 85244	0.54	Name split from “Last, First”Date of birth unreadable Phone reformatted Unit split from street+1 more
CLM-405145	CLM	Alexis Q Ramirez	1964-04-18	—	—	7736 Ocean Ave, Gilbert, AZ, 85257	0.54	Two-digit birth year Phone missing area code Street suffix standardised Address re-cased+1 more
CLM-405144	CLM	Alexis Q Ramirez	1964-04-18	—	—	7736 Ocean Ave, Gilbert, AZ, 85257	0.54	Two-digit birth year Phone missing area code Street suffix standardised Address re-cased+1 more
CLM-417727	CLM	Logan Yang	1967-09-12	—	—	219 Lincoln Way # 494, San Antonio, TX, 78217	0.54	Name split from “Last, First”Two-digit birth year Unit split from street Whitespace trimmed+1 more
CLM-400440	CLM	Juen Castro	1979-08-01	—	—	3550 Sunset Blvd, San Antonio, TX, 78261	0.54	Two-digit birth year State name converted to code ZIP+4 trimmed Whitespace trimmed+1 more
CLM-401049	CLM	Christina Singh	1972-07-12	UHC-36281-66	—	1049 Harbor Blvd, Tempe, AZ	0.54	State name converted to code ZIP missing Gender normalised Whitespace trimmed+1 more
CLM-401048	CLM	Christina Singh	1972-07-12	UHC-36281-66	—	1049 Harbor Blvd, Tempe, AZ	0.54	State name converted to code ZIP missing Gender normalised Whitespace trimmed+1 more
CLM-404707	CLM	Yuki X Espinoza	1951-06-16	—	2243679502	387 Harbor Blvd, Charlotte, NC, 28206	0.54	Name split from “Last, First”ZIP+4 trimmed Gender normalised Whitespace trimmed+1 more
CLM-425222	CLM	Jacqueline Hayes	1983-05-03	—	—	—	0.54	Name split from “Last, First”Phone missing area code Gender normalised Whitespace trimmed+1 more
CLM-423817	CLM	Yuki T Johnson	—	UHC-34539-08	—	—	0.54	Name split from “Last, First”Date of birth unreadable Phone missing area code Whitespace trimmed+1 more
CLM-403854	CLM	Margaret Torres	1995-06-22	UHC-34210-05	—	1549 Ridge Rd, Jacksonville, FL, 32292	0.54	Name split from “Last, First”City re-cased ZIP+4 trimmed Gender normalised+1 more
CLM-430039	CLM	Timothy P George	1941-06-24	UHC-62919-01	2412813785	4259 Valley View Dr, San Diego, CA	0.54	Middle initial moved out of first name State name converted to code ZIP missing Whitespace trimmed+1 more
CLM-411617	CLM	Christopher E Peterson	2001-06-01	UHC-41454-71	4827086188	8720 Grand Ave Apt 24, Phoenix, AZ, 85090	0.54	Unit split from street Street suffix standardised Address re-cased Gender normalised+1 more
CLM-410140	CLM	Isabella Le	1954-04-14	UHC-22656-20	9298176639	7791 Desert Sky Blvd, Orlando, FL, 32846	0.54	SSN last four extracted ZIP+4 trimmed Gender normalised Whitespace trimmed+1 more
CLM-406309	CLM	Joseph Thompson	1944-11-23	—	—	—	0.54	Name split from “Last, First”Two-digit birth year Gender normalised Whitespace trimmed+1 more
CLM-419417	CLM	Jimmy Long	1972-08-16	UHC-80524-88	—	6078 Mountain View Dr, Nashville, TN, 37251	0.54	Two-digit birth year Phone missing area code Gender normalised Whitespace trimmed+1 more
CLM-432042	CLM	Virginia Carlson	1993-03-18	UHC-04926-88	—	4591 Valley View Dr Apt 18, Dallas, TX, 75241	0.54	Unit split from street State name converted to code ZIP+4 trimmed Whitespace trimmed+1 more
CLM-412318	CLM	John Burke	1977-07-17	—	—	126 Main St, Tempe, AZ	0.54	Two-digit birth year State name converted to code ZIP missing Whitespace trimmed+1 more
CLM-412317	CLM	John Burke	1977-07-17	—	—	126 Main St, Tempe, AZ	0.54	Two-digit birth year State name converted to code ZIP missing Whitespace trimmed+1 more
CLM-430428	CLM	Sophia Welch	1938-07-16	UHC-08969-87	—	9297 Church St, San Diego, CA, 92171	0.54	State name converted to code ZIP+4 trimmed Gender normalised Whitespace trimmed+1 more
CLM-431046	CLM	Christine Sullivan	2007-09-24	UHC-86497-82	—	4856 Indian School Rd, Eden Prairie, MN, 55332	0.54	Name split from “Last, First”ZIP+4 trimmed Gender normalised Whitespace trimmed+1 more
CLM-421816	CLM	Willie Y Allen	1989-10-21	UHC-31609-15	—	4882 Highland Ave, Denver, CO, 80291	0.54	Name split from “Last, First”State name converted to code ZIP+4 trimmed Whitespace trimmed+1 more
CLM-405048	CLM	Tim Lopez	1946-01-15	UHC-58975-81	—	9308 Meadow Ln # 186, Nashville, TN, 37271	0.54	Name split from “Last, First”Unit split from street State name converted to code Whitespace trimmed+1 more
CLM-409143	CLM	Maria Castillo	1949-05-11	UHC-29981-05	7092147452	696 Indian School Rd, Tucson, AZ, 85711	0.54	Name split from “Last, First”ZIP+4 trimmed Gender normalised Whitespace trimmed+1 more
CLM-402449	CLM	Betsy V Freeman	1945-09-03	—	—	3288 Valley View Dr, Denver, CO, 80200	0.54	Phone missing area code Street suffix standardised Address re-cased State name converted to code+1 more
CLM-428715	CLM	Frances Spencer	1992-07-12	—	—	—	0.54	Two-digit birth year Phone missing area code Gender normalised Whitespace trimmed+1 more
CLM-407324	CLM	Michael Ray	1942-10-25	UHC-73727-67	—	6408 Desert Sky Blvd, Dallas, TX	0.54	Street suffix standardised Address re-cased State name converted to code ZIP missing+1 more
CLM-424720	CLM	Joan Weber	—	UHC-41593-57	—	2151 Canyon Rd, Los Angeles, CA	0.54	Date of birth unreadable ZIP missing Gender normalised Whitespace trimmed+1 more
CLM-427480	CLM	Wayne X Castillo	1957-03-05	UHC-95042-59	—	—	0.54	Middle initial moved out of first name Two-digit birth year Phone missing area code Whitespace trimmed+1 more
CLM-427481	CLM	Wayne X Castillo	1957-03-05	UHC-95042-59	—	—	0.54	Middle initial moved out of first name Two-digit birth year Phone missing area code Whitespace trimmed+1 more
CLM-400603	CLM	Katherine B Spencer	1941-12-05	UHC-92145-04	—	7159 Jefferson Ave, Eden Prairie, MN	0.54	Street suffix standardised Address re-cased State name converted to code ZIP missing+1 more
CLM-416403	CLM	Harold Rojas	—	UHC-16881-88	—	4310 Ridge Rd, Fresno, CA, 93794	0.54	Date of birth unreadable Phone missing area code State name converted to code Whitespace trimmed+1 more
CLM-416402	CLM	Harold Rojas	—	UHC-16881-88	—	4310 Ridge Rd, Fresno, CA, 93794	0.54	Date of birth unreadable Phone missing area code State name converted to code Whitespace trimmed+1 more
CLM-430168	CLM	Lawrence I Ray	—	UHC-62884-26	—	475 Pine Dr, Jacksonville, FL, 32213	0.54	Name split from “Last, First”Date of birth unreadable ZIP+4 trimmed Whitespace trimmed+1 more
CLM-402301	CLM	Lawrece K Johnston	1952-10-18	UHC-57335-96	—	5968 Park Pl, Chandler, AZ, 85223	0.54	Street suffix standardised Address re-cased ZIP+4 trimmed Gender normalised+1 more
CLM-407999	CLM	Jean Waatkins	1990-03-21	—	—	5101 Mountain View Dr, Seattle, WA	0.54	Name split from “Last, First”State name converted to code ZIP missing Whitespace trimmed+1 more
CLM-422571	CLM	Valentina Wong	—	UHC-87911-51	—	—	0.54	Name split from “Last, First”Date of birth unreadable Gender normalised Whitespace trimmed+1 more
CLM-426420	CLM	Wei Nichols	—	—	—	8744 Sunset Blvd, Chandler, AZ	0.54	Date of birth missing State name converted to code ZIP missing Whitespace trimmed+1 more
CLM-407191	CLM	Kevin Peters	—	—	—	2466 Broadway, Columbus, OH, 43297	0.54	Name split from “Last, First”Date of birth unreadable Gender normalised Whitespace trimmed+1 more
CLM-431392	CLM	Jerry Roberts	2005-11-21	—	—	—	0.54	Name split from “Last, First”Two-digit birth year Gender normalised Whitespace trimmed+1 more
CLM-415181	CLM	Bradley Oliver	—	UHC-67161-27	—	5188 Union St, Tampa, FL, 33656	0.54	Name split from “Last, First”Date of birth unreadable Gender normalised Whitespace trimmed+1 more

18,771 rows, page 35 of 376Previous Next