Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Whitespace trimmed”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagWhitespace trimmedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-421354	CLM	Jacuqeline R Siingh	1983-10-16	—	7268393172	8898 Forest Ave, Denver, CO, 80241	0.68	Name split from “Last, First”State name converted to code Whitespace trimmed Placeholder values cleared
CLM-411608	CLM	Lawrence Weaver	1964-02-04	UHC-26133-98	9292120024	3519 Church St Apt 15, Tempe, AZ, 85219	0.68	Name split from “Last, First”Date of birth reformatted Unit split from street Whitespace trimmed
CLM-432151	CLM	Timothy Nunez	—	UHC-87616-06	7109259699	3333 Church St, Los Angeles, CA, 90015	0.68	Name split from “Last, First”Date of birth unreadable Whitespace trimmed Placeholder values cleared
CLM-432543	CLM	Paul P Kelly	1989-01-13	UHC-35201-48	—	7184 Apache Blvd, Seattle, WA, 98118	0.68	SSN last four extracted Gender normalised Whitespace trimmed Placeholder values cleared
CLM-417349	CLM	Diana Bell	1949-01-04	UHC-46851-26	—	6694 Canyon Rd, San Diego, CA	0.68	Two-digit birth year ZIP missing Whitespace trimmed Placeholder values cleared
CLM-408373	CLM	Carl Pierce	2006-11-15	—	—	8360 Sage Ct, Las Vegas, NV, 89145	0.68	Name split from “Last, First”State name converted to code Whitespace trimmed Placeholder values cleared
CLM-401934	CLM	Albert Miller	1940-02-09	UHC-57977-59	—	5580 Hillcrest Rd, Orlando, FL, 32870	0.68	Two-digit birth year State name converted to code Whitespace trimmed Placeholder values cleared
CLM-427824	CLM	Donna Ramos	1995-10-06	—	—	7499 Baseline Rd Apt 27, Tempe, AZ	0.68	Unit split from street ZIP missing Whitespace trimmed Placeholder values cleared
CLM-427825	CLM	Donna Ramos	1995-10-06	—	—	7499 Baseline Rd Apt 27, Tempe, AZ	0.68	Unit split from street ZIP missing Whitespace trimmed Placeholder values cleared
CLM-432797	CLM	Stephen Murray	1962-05-26	UHC-92761-01	—	4148 Main St, Seattle, WA, 98101	0.68	Name split from “Last, First”Gender normalised Whitespace trimmed Placeholder values cleared
CLM-421082	CLM	Robert Guerrero	1949-03-04	UHC-68316-58	—	1020 Washington St # 978, Orlando, FL, 32834	0.68	Name split from “Last, First”Unit split from street Whitespace trimmed Placeholder values cleared
CLM-419545	CLM	Zachary Evans	1988-09-27	—	—	724 Forest Ave, Scottsdale, AZ	0.68	ZIP missing Gender normalised Whitespace trimmed Placeholder values cleared
CLM-426441	CLM	Ryan Santos	1943-02-27	UHC-94423-25	—	—	0.68	Name split from “Last, First”Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-412794	CLM	Juan B Carpenter	2000-06-11	UHC-33252-10	—	—	0.68	Name split from “Last, First”Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-419588	CLM	Karen R Stewart	—	—	3985202442	—	0.68	Name split from “Last, First”Date of birth missing Whitespace trimmed Placeholder values cleared
CLM-422994	CLM	Betty G Gomez	1977-06-09	UHC-79259-25	—	347 Main St, Tampa, FL	0.68	State name converted to code ZIP missing Whitespace trimmed Placeholder values cleared
CLM-408537	CLM	John Reyes	2004-01-07	UHC-52250-13	—	1791 Elm St, Tempe, AZ, 85253	0.68	Two-digit birth year ZIP+4 trimmed Whitespace trimmed Placeholder values cleared
CLM-409191	CLM	Jerry Rojas	1995-09-22	—	—	4528 Maple Ave, Mesa, AZ, 85293	0.68	Name split from “Last, First”Gender normalised Whitespace trimmed Placeholder values cleared
CLM-409192	CLM	Jerry Rojas	1995-09-22	—	—	4528 Maple Ave, Mesa, AZ, 85293	0.68	Name split from “Last, First”Gender normalised Whitespace trimmed Placeholder values cleared
CLM-429220	CLM	Aisha Larson	1949-09-22	—	—	3250 Broadway, Eden Prairie, MN	0.68	SSN last four extracted ZIP missing Whitespace trimmed Placeholder values cleared
CLM-411165	CLM	Kevin L Soto	1955-12-09	—	—	3195 Meadow Ln, San Antonio, TX, 78261	0.68	Two-digit birth year State name converted to code Whitespace trimmed Placeholder values cleared
CLM-421922	CLM	Theresa Henry	1991-12-11	—	—	8184 Meadow Ln Apt 13, San Diego, CA, 92175	0.68	Unit split from street ZIP+4 trimmed Whitespace trimmed Placeholder values cleared
CLM-427725	CLM	Albert C Delgado	1939-08-14	—	—	—	0.68	Two-digit birth year Gender normalised Whitespace trimmed Placeholder values cleared
CLM-410060	CLM	Yuki F Meyer	1950-06-01	UHC-39552-52	—	—	0.68	Name split from “Last, First”Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-416574	CLM	Ethan Welch	1949-09-13	UHC-59122-39	—	1962 Mesa Dr, San Antonio, TX, 78221	0.68	Name split from “Last, First”Gender normalised Whitespace trimmed Placeholder values cleared
CLM-429443	CLM	Megan Luna	1962-09-26	UHC-51148-57	—	5143 Hillcrest Rd, Scottsdale, AZ, 85259	0.68	State name converted to code Gender normalised Whitespace trimmed Placeholder values cleared
CLM-409876	CLM	Jason Guerrero	1949-07-19	UHC-14738-35	—	—	0.68	Name split from “Last, First”Gender normalised Whitespace trimmed Placeholder values cleared
CLM-428965	CLM	Cheryl Parker	2003-03-02	—	—	6087 Lincoln Way, Nashville, TN, 37270	0.68	State name converted to code ZIP+4 trimmed Whitespace trimmed Placeholder values cleared
CLM-411337	CLM	Margaret Roberts	—	—	—	—	0.68	Date of birth unreadable Gender normalised Whitespace trimmed Placeholder values cleared
CLM-406625	CLM	Kathleen Graham	2000-12-23	UHC-53630-10	—	8422 Union St, Fresno, CA	0.68	State name converted to code ZIP missing Whitespace trimmed Placeholder values cleared
CLM-402516	CLM	Ethan K Estrada	1966-04-28	UHC-68529-89	2913627424	5007 Apache Blvd # 725, Chandler, AZ, 85229	0.68	Name split from “Last, First”Unit split from street Whitespace trimmed Placeholder values cleared
CLM-428400	CLM	Jeremy Greeen	1999-09-19	—	—	638 Meadow Ln Apt 14, Gilbert, AZ, 85272	0.68	Name split from “Last, First”Unit split from street Whitespace trimmed Placeholder values cleared
CLM-425763	CLM	Theresa Olson	1996-07-03	UHC-42656-48	—	9830 Broadway, Houston, TX, 77004	0.68	Name split from “Last, First”SSN last four extracted Address re-cased Whitespace trimmed
CLM-402917	CLM	Roy Tucker	1946-01-17	UHC-34706-33	—	7341 Oak St Apt 15, Atlanta, GA, 30300	0.68	Name split from “Last, First”Unit split from street Whitespace trimmed Placeholder values cleared
CLM-416422	CLM	Roger Bishop	1960-11-05	—	—	2419 Park Pl, Atlanta, GA, 30379	0.68	Name split from “Last, First”Gender normalised Whitespace trimmed Placeholder values cleared
CLM-418509	CLM	Steven R Bowman	1941-09-01	UHC-95679-56	—	8216 Cedar Ln, Orlando, FL, 32899	0.68	Name split from “Last, First”Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-431114	CLM	David V Armstrong	2003-07-06	UHC-36225-03	—	6241 Hillcrest Rd # 245, Glendale, AZ, 85369	0.68	Two-digit birth year Unit split from street Whitespace trimmed Placeholder values cleared
CLM-430150	CLM	Samantha Howard	1955-11-11	UHC-54388-27	—	7572 Cedar Ln, Gilbert, AZ, 85280	0.68	Name split from “Last, First”Gender normalised Whitespace trimmed Placeholder values cleared
CLM-416041	CLM	Kathryn A Hayes	1971-09-11	—	—	9284 Cedar Ln, Jacksonville, FL, 32261	0.68	Street suffix standardised Address re-cased Gender normalised Whitespace trimmed
CLM-430411	CLM	Bradley F Larson	1960-11-16	—	—	9556 Maple Ave # 206, Phoenix, AZ, 85057	0.68	Unit split from street ZIP+4 trimmed Whitespace trimmed Placeholder values cleared
CLM-404843	CLM	Yuki Nguyen	1955-01-22	—	—	1631 Jefferson Ave Apt 28, Orlando, FL	0.68	Unit split from street ZIP missing Whitespace trimmed Placeholder values cleared
CLM-410880	CLM	Abigail Gray	1998-07-12	—	—	—	0.68	Two-digit birth year Gender normalised Whitespace trimmed Placeholder values cleared
CLM-428176	CLM	Greg Rosse	—	UHC-54198-54	—	—	0.68	Date of birth unreadable Gender normalised Whitespace trimmed Placeholder values cleared
CLM-428175	CLM	Greg Rosse	—	UHC-54198-54	—	—	0.68	Date of birth unreadable Gender normalised Whitespace trimmed Placeholder values cleared
CLM-430719	CLM	Eugene Reyes	1966-05-18	UHC-92197-11	—	—	0.68	Name split from “Last, First”Gender normalised Whitespace trimmed Placeholder values cleared
CLM-402763	CLM	Jacob Evans	—	UHC-30782-04	—	2290 Spring St, Jacksonville, FL, 32244	0.68	Date of birth missing Gender normalised Whitespace trimmed Placeholder values cleared
CLM-428441	CLM	Teresa Spencer	1995-05-10	UHC-23682-43	—	5215 Grand Ave, San Diego, CA, 92120	0.68	ZIP+4 trimmed Gender normalised Whitespace trimmed Placeholder values cleared
CLM-410124	CLM	Abigail Hicks	1970-08-17	UHC-60211-80	—	5753 Union St, Miami, FL, 33105	0.68	State name converted to code Gender normalised Whitespace trimmed Placeholder values cleared
CLM-421914	CLM	Helen Mills	—	UHC-72226-56	6919339184	8254 Cedar Ln Apt 27, San Diego, CA, 92127	0.68	Date of birth unreadable Phone reformatted Unit split from street Whitespace trimmed
CLM-413587	CLM	Whie Melissa	2000-05-10	UHC-48799-02	—	—	0.68	Name split from “Last, First”SSN last four extracted Whitespace trimmed Placeholder values cleared

18,771 rows, page 128 of 376Previous Next