Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Email lower-cased”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagEmail lower-casedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-420106	CLM	Zachary Marshall	2001-11-21	—	—	7657 Lake View Rd, Atlanta, GA, 30340	0.80	Street suffix standardised Address re-cased Email lower-cased Placeholder values cleared
CLM-413350	CLM	Emma Mendez	1954-05-08	—	2403833741	5770 Indian School Rd, Eden Prairie, MN, 55348	0.80	Phone reformatted State name converted to code Email lower-cased Placeholder values cleared
CLM-427845	CLM	Bryan Y Mitchell	1999-02-03	—	6647059422	7660 Baseline Rd, Sacramento, CA, 95833	0.80	Phone reformatted State name converted to code Email lower-cased Placeholder values cleared
CLM-404024	CLM	Steven Guzman	2001-11-20	UHC-15163-18	—	6461 Mesa Dr, Las Vegas, NV, 89120	0.80	Name re-cased Email lower-cased Gender normalised Whitespace trimmed
CLM-400605	CLM	Marcus Hall	1947-12-15	—	—	—	0.82	Phone missing area code Email lower-cased Placeholder values cleared
CLM-418093	CLM	Kathryn Jenkins	1979-07-12	UHC-10064-66	—	—	0.82	Name split from “Last, First”Email lower-cased Placeholder values cleared
CLM-418921	CLM	Carol Gibson	1940-11-10	UHC-92939-34	—	—	0.82	Email lower-cased Gender normalised Placeholder values cleared
CLM-408924	CLM	Christopher Hawkins	1961-01-06	UHC-49024-83	—	—	0.82	Two-digit birth year Email lower-cased Placeholder values cleared
CLM-408304	CLM	Frances Burns	1977-06-07	UHC-13404-99	—	—	0.82	Two-digit birth year Email lower-cased Placeholder values cleared
CLM-410727	CLM	Jose Weber	1957-04-10	UHC-75597-59	—	—	0.82	Name split from “Last, First”Email lower-cased Placeholder values cleared
CLM-423091	CLM	Amber N Watkins	1976-10-16	—	—	9383 Baseline Rd, Tempe, AZ, 85292	0.82	ZIP+4 trimmed Email lower-cased Placeholder values cleared
CLM-407009	CLM	Emily Silva	—	UHC-43687-71	7229420514	4265 Union St, Los Angeles, CA, 90067	0.82	Date of birth unreadable City re-cased Email lower-cased
CLM-423776	CLM	Douglas Guzman	1939-05-04	—	4143293966	4355 Mountain View Dr, Tempe, AZ, 85299	0.82	Name split from “Last, First”Email lower-cased Placeholder values cleared
CLM-426112	CLM	Lucas C Emily	1987-03-01	UHC-93210-78	—	3260 Lincoln Way, Orlando, FL	0.82	ZIP missing Email lower-cased Placeholder values cleared
CLM-404371	CLM	Anthony Kennedy	1982-05-09	—	—	621 Forest Ave, Fresno, CA, 93749	0.82	Email lower-cased Gender normalised Whitespace trimmed
CLM-412491	CLM	Henry Nguyen	1975-07-18	UHC-89598-34	—	—	0.82	Name split from “Last, First”Email lower-cased Placeholder values cleared
CLM-418722	CLM	Rlph Bell	1976-11-03	—	—	8457 Apache Blvd, Tempe, AZ, 85201	0.82	Email lower-cased Gender normalised Placeholder values cleared
CLM-417379	CLM	Gerald Jordan	1950-10-14	UHC-54565-76	—	4097 Apache Blvd, Sacramento, CA, 95826	0.82	Street suffix standardised Address re-cased Email lower-cased
CLM-408116	CLM	Kymberly Cox	1993-05-03	—	—	—	0.82	Name split from “Last, First”Email lower-cased Placeholder values cleared
CLM-414728	CLM	Janet Y Munoz	1941-09-07	—	4469016354	—	0.82	Email lower-cased Gender normalised Placeholder values cleared
CLM-406904	CLM	Joshua White	1984-09-10	UHC-58233-88	—	—	0.82	Name split from “Last, First”Email lower-cased Placeholder values cleared
CLM-426110	CLM	Marcus D Gilbert	1994-03-03	UHC-89377-66	—	6817 Forest Ave, Glendale, AZ, 85358	0.82	Name split from “Last, First”Email lower-cased Placeholder values cleared
CLM-410865	CLM	Jacqueline Flores	1939-12-16	UHC-03070-53	4285278069	8553 Spring St, Tampa, FL, 33668	0.82	Two-digit birth year Member ID reformatted Email lower-cased
CLM-407988	CLM	Katherine E Ford	1993-07-16	UHC-11119-53	—	9302 Main St, Tucson, AZ, 85720	0.82	State name converted to code Email lower-cased Whitespace trimmed
CLM-401074	CLM	Janet Sanchez	2007-08-22	UHC-19523-28	—	3187 Hillcrest Rd, Tucson, AZ, 85782	0.82	Two-digit birth year Email lower-cased Placeholder values cleared
CLM-421458	CLM	Samantha Ray	1990-09-03	—	4922997700	464 Jefferson Ave, Denver, CO	0.82	Phone reformatted ZIP missing Email lower-cased
CLM-411702	CLM	Wei Robinson	1985-07-06	—	—	—	0.82	Name split from “Last, First”Email lower-cased Placeholder values cleared
CLM-428067	CLM	Jason Hunt	1963-12-08	—	—	3113 Park Pl, Tempe, AZ, 85216	0.82	Two-digit birth year Email lower-cased Placeholder values cleared
CLM-411211	CLM	Madison Rivera	1984-04-07	UHC-25876-36	—	6960 Broadway, Tucson, AZ, 85702	0.84	Email lower-cased Gender normalised
CLM-414627	CLM	Kathleen Andrews	1960-05-22	UHC-09149-87	3092080763	4573 Baseline Rd, Phoenix, AZ, 85036	0.86	Name re-cased Date of birth reformatted Phone reformatted State code upper-cased+3 more
CLM-420008	CLM	Patricia Z Dixon	1980-05-05	UHC-19955-99	8944666462	4078 Elm St, Charlotte, NC, 28210	0.86	Name re-cased Date of birth reformatted Phone reformatted Member ID reformatted+3 more
CLM-421318	CLM	Jennifer Weber	1946-07-05	UHC-83139-76	9197241137	—	0.88	Name re-cased Date of birth reformatted Phone reformatted Email lower-cased+2 more
CLM-426057	CLM	Evelyn Ruiz	1969-09-25	UHC-60263-23	—	—	0.88	Name re-cased Date of birth reformatted Member ID reformatted Email lower-cased+2 more
CLM-418207	CLM	Janice Valdez	1979-01-23	UHC-71780-60	—	—	0.88	Name re-cased Date of birth reformatted Member ID reformatted Email lower-cased+2 more
CLM-407170	CLM	Nicholas Gibson	1948-06-11	—	8219769250	6030 Camelback Rd, Minneapolis, MN, 55489	0.88	Date of birth reformatted Phone reformatted City re-cased Email lower-cased+2 more
CLM-431867	CLM	Ronald G Meyer	2000-05-27	—	5777411106	8153 Broadway, Mesa, AZ, 85274	0.88	Name re-cased Address re-cased City re-cased Email lower-cased+2 more
CLM-404172	CLM	Joseph Wright	1976-04-20	UHC-09052-51	—	2096 Willow Ct, Tampa, FL, 33660	0.88	Name re-cased Date of birth reformatted State code upper-cased Email lower-cased+2 more
CLM-402615	CLM	Joseph Mitchell	1991-08-04	UHC-11166-10	—	9484 Highland Ave, Tucson, AZ, 85796	0.88	Name re-cased Date of birth reformatted State code upper-cased Email lower-cased+2 more
CLM-412937	CLM	Maria McDonald	1959-09-15	UHC-99859-28	4795566129	8254 Cedar Ln, Glendale, AZ, 85327	0.88	Date of birth reformatted Phone reformatted Member ID reformatted Email lower-cased+2 more
CLM-419856	CLM	Rechel Dunn	1979-12-14	UHC-82112-42	—	—	0.88	Name re-cased Date of birth reformatted Member ID reformatted Email lower-cased+2 more
CLM-411522	CLM	Aaron Webb	1964-02-02	UHC-01857-64	3242847345	8555 Apache Blvd, San Antonio, TX, 78290	0.88	Name re-cased Phone reformatted Member ID reformatted City re-cased+2 more
CLM-432530	CLM	Robert Lewis	1938-06-12	UHC-97618-20	3827826549	1524 Oak St, Sacramento, CA, 95858	0.88	Name re-cased Phone reformatted State code upper-cased Email lower-cased+2 more
CLM-431585	CLM	Marilyn Dominguez	1991-04-14	UHC-83227-42	4116909711	6157 Camelback Rd, Fresno, CA, 93745	0.88	Date of birth reformatted Phone reformatted Member ID reformatted Email lower-cased+2 more
CLM-417143	CLM	Santiago Edwards	2005-04-18	UHC-35700-34	6012477087	2556 Oak St, Sacramento, CA, 95847	0.88	Name re-cased Phone reformatted State code upper-cased Email lower-cased+2 more
CLM-412384	CLM	Mariana U Wagner	1966-02-27	UHC-61747-82	—	—	0.88	Name re-cased Date of birth reformatted Email lower-cased Plan code upper-cased+2 more
CLM-405474	CLM	Albert Olson	1947-11-08	—	8178794171	—	0.88	Name re-cased Date of birth reformatted Phone reformatted Email lower-cased+2 more
CLM-410065	CLM	Brenda Watkins	1969-04-22	UHC-95987-55	3154705866	5769 Camelback Rd, Atlanta, GA, 30317	0.90	Name re-cased Date of birth reformatted Email lower-cased Whitespace trimmed+1 more
CLM-422103	CLM	Jean Chavez	1965-06-07	UHC-97809-22	7673313354	—	0.90	Name re-cased Phone reformatted Email lower-cased Whitespace trimmed+1 more
CLM-406500	CLM	Barb Lynch	1958-02-01	UHC-29653-61	2557232605	8824 Maple Ave, Austin, TX, 78742	0.90	Phone reformatted City re-cased Email lower-cased Plan code upper-cased+1 more
CLM-429539	CLM	Ahmed Sanders	1969-10-02	UHC-18360-29	7449930595	—	0.90	Date of birth reformatted Phone reformatted Email lower-cased Whitespace trimmed+1 more

989 rows, page 15 of 20Previous Next