Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “ZIP missing”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagZIP missingClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-405990	CLM	Joshua B Marshall	1942-02-26	UHC-44961-96	—	8078 Canyon Rd, Mesa, AZ	0.68	Street suffix standardised Address re-cased ZIP missing Placeholder values cleared
CLM-418230	CLM	Teresa Crawford	1958-02-21	UHC-27980-16	—	1006 Indian School Rd, Gilbert, AZ	0.68	Street suffix standardised Address re-cased ZIP missing Placeholder values cleared
CLM-418231	CLM	Teresa Crawford	1958-02-21	UHC-27980-16	—	1006 Indian School Rd, Gilbert, AZ	0.68	Street suffix standardised Address re-cased ZIP missing Placeholder values cleared
CLM-406625	CLM	Kathleen Graham	2000-12-23	UHC-53630-10	—	8422 Union St, Fresno, CA	0.68	State name converted to code ZIP missing Whitespace trimmed Placeholder values cleared
CLM-412916	CLM	Robert Bradley	1977-07-08	UHC-63686-35	—	3063 Desert Sky Blvd, Fresno, CA	0.68	Name re-cased Street suffix standardised Address re-cased ZIP missing
CLM-403138	CLM	Mei S Brooks	1986-10-23	—	9869731343	2240 Lake View Rd, Scottsdale, AZ	0.68	Street suffix standardised Address re-cased City re-cased ZIP missing
CLM-404843	CLM	Yuki Nguyen	1955-01-22	—	—	1631 Jefferson Ave Apt 28, Orlando, FL	0.68	Unit split from street ZIP missing Whitespace trimmed Placeholder values cleared
CLM-430057	CLM	Christine Phillips	1989-02-18	UHC-86842-73	—	3969 Hillcrest Rd, Gilbert, AZ	0.68	Name re-cased Two-digit birth year ZIP missing Placeholder values cleared
CLM-418618	CLM	Natalie Ramos	1987-04-27	UHC-03397-06	—	926 Spring St, Tempe, AZ	0.68	Street suffix standardised Address re-cased ZIP missing Placeholder values cleared
CLM-423667	CLM	Frances Morrison	1943-06-13	UHC-70290-96	4013722830	6190 Camelback Rd, Minneapolis, MN	0.68	Date of birth reformatted State name converted to code ZIP missing Placeholder values cleared
CLM-431184	CLM	Jean Nunez	—	—	—	1238 Central Ave, Nashville, TN	0.68	Date of birth unreadable ZIP missing Whitespace trimmed Placeholder values cleared
CLM-429411	CLM	Raymond J Day	1984-07-02	—	8372569229	8570 Main St, Miami, FL	0.68	Name re-cased Two-digit birth year ZIP missing Whitespace trimmed
CLM-408565	CLM	Janet Carroll	1980-01-11	UHC-53874-23	—	4277 Elm St, Tucson, AZ	0.68	Street suffix standardised Address re-cased ZIP missing Placeholder values cleared
CLM-411192	CLM	Brandoon Bennett	1950-02-23	UHC-33676-78	—	3332 Bayshore Dr, Sacramento, CA	0.68	SSN last four extracted ZIP missing Whitespace trimmed Placeholder values cleared
CLM-418898	CLM	Wei Willys	1967-01-27	UHC-15137-52	—	4703 Indian School Rd, Eden Prairie, MN	0.68	Two-digit birth year City re-cased ZIP missing Whitespace trimmed
CLM-400600	CLM	Carolyn Dixon	1973-10-21	UHC-69047-67	—	1496 Camelback Rd, Austin, TX	0.68	Street suffix standardised Address re-cased ZIP missing Placeholder values cleared
CLM-407757	CLM	Doris Brown	1963-07-09	UHC-03661-81	—	5032 Lake View Rd, Tempe, AZ	0.68	ZIP missing Gender normalised Whitespace trimmed Placeholder values cleared
CLM-414353	CLM	Rebecca Lewis	1967-03-26	—	—	6545 Maple Ave, Nashville, TN	0.68	Street suffix standardised Address re-cased ZIP missing Placeholder values cleared
CLM-422125	CLM	Donald Patel	1989-03-28	—	7724414294	958 Cedar Ln, Denver, CO	0.68	Name split from “Last, First”ZIP missing Whitespace trimmed Placeholder values cleared
CLM-429290	CLM	Virginia Wong	1971-03-07	—	6714357218	6349 River Rd, Chandler, AZ	0.68	Phone reformatted ZIP missing Gender normalised Placeholder values cleared
CLM-430217	CLM	Virginia Hansen	—	UHC-14278-08	—	3692 Sunset Blvd, Jacksonville, FL	0.70	Date of birth unreadable ZIP missing Placeholder values cleared
CLM-426762	CLM	Brian Stone	1973-10-20	UHC-93876-66	—	1030 Highland Ave, San Diego, CA	0.70	Name split from “Last, First”ZIP missing Placeholder values cleared
CLM-409413	CLM	Lori Riley	1951-07-08	—	—	5708 Grand Ave, Nashville, TN	0.70	State name converted to code ZIP missing Placeholder values cleared
CLM-401347	CLM	Rebecca H Sims	1938-07-04	—	—	9430 Broadway, Seattle, WA	0.70	ZIP missing Gender normalised Placeholder values cleared
CLM-404264	CLM	Nicholas Fuller	1983-02-08	UHC-17681-49	3246093501	4462 Sage Ct, Las Vegas, NV	0.70	ZIP missing Gender normalised Whitespace trimmed
CLM-419939	CLM	Mateo Diaz	1952-06-25	UHC-92907-25	—	2968 Apache Blvd, Houston, TX	0.70	Name split from “Last, First”ZIP missing Placeholder values cleared
CLM-400989	CLM	Amber Greene	1942-05-19	UHC-79174-43	—	7738 Market St, Denver, CO	0.70	Name split from “Last, First”ZIP missing Placeholder values cleared
CLM-416028	CLM	Brenda Nguyen	—	UHC-96686-39	7399664939	5028 Harbor Blvd, San Diego, CA	0.70	Date of birth missing ZIP missing Placeholder values cleared
CLM-408837	CLM	Lawrence Gutierrez	1943-12-13	UHC-49649-11	—	3482 Jefferson Ave, Columbus, OH	0.70	Name split from “Last, First”ZIP missing Placeholder values cleared
CLM-403609	CLM	Robert F Jordan	1974-09-10	—	—	6722 Meadow Ln, Miami, FL	0.70	ZIP missing Gender normalised Placeholder values cleared
CLM-429431	CLM	Dorothy Collins	2002-11-16	UHC-40897-12	7483866583	7220 Forest Ave, Mesa, AZ	0.70	Name split from “Last, First”City re-cased ZIP missing
CLM-417909	CLM	Bradley Herrera	2006-02-10	UHC-52427-22	—	3645 Mountain View Dr, Scottsdale, AZ	0.70	Name split from “Last, First”ZIP missing Placeholder values cleared
CLM-401960	CLM	Sofia Garza	1971-11-23	UHC-84750-50	—	8092 Park Pl, San Antonio, TX	0.70	Street suffix standardised Address re-cased ZIP missing
CLM-426127	CLM	Victoria Rogers	2008-05-10	UHC-57091-14	—	1444 Indian School Rd, Plano, TX	0.70	Phone missing area code ZIP missing Placeholder values cleared
CLM-410360	CLM	Ahmed Riley	2007-03-13	—	—	5024 Hillcrest Rd, Jacksonville, FL	0.70	State name converted to code ZIP missing Placeholder values cleared
CLM-416685	CLM	Nathan Reid	2008-12-27	UHC-64789-70	7248086884	7259 Mesa Dr, Glendale, AZ	0.70	Phone reformatted ZIP missing Gender normalised
CLM-412893	CLM	Joe Richards	1945-09-03	—	—	5655 Ridge Rd, Minneapolis, MN	0.70	ZIP missing Gender normalised Placeholder values cleared
CLM-421194	CLM	Omar Coleman	1979-12-02	UHC-91190-23	—	4576 Camelback Rd, Sacramento, CA	0.70	ZIP missing Email lower-cased Gender normalised
CLM-429102	CLM	Brenda Phillips	1961-06-05	—	8043537023	1876 Central Ave, Miami, FL	0.70	Two-digit birth year ZIP missing Placeholder values cleared
CLM-415439	CLM	Aeron Fisher	1993-10-26	UHC-39898-77	—	1654 Ocean Ave, Jacksonville, FL	0.70	Phone missing area code ZIP missing Placeholder values cleared
CLM-428529	CLM	Marai Wagner	1975-03-09	—	—	5713 Indian School Rd, Columbus, OH	0.70	State name converted to code ZIP missing Placeholder values cleared
CLM-430899	CLM	Richardson Grace	1979-11-01	UHC-05731-22	—	489 Ocean Ave, Scottsdale, AZ	0.70	State name converted to code ZIP missing Placeholder values cleared
CLM-426501	CLM	Gregory Alvarez	1982-03-27	UHC-67391-14	—	1067 Oak St # 230, Tempe, AZ	0.70	Unit split from street ZIP missing Placeholder values cleared
CLM-430806	CLM	Omar Peters	1952-12-22	—	—	6842 Cedar Ln, Gilbert, AZ	0.70	State name converted to code ZIP missing Placeholder values cleared
CLM-421667	CLM	Richard Hamillton	2001-10-03	UHC-08968-49	2156053528	4119 Highland Ave, Columbus, OH	0.70	State name converted to code ZIP missing Placeholder values cleared
CLM-412023	CLM	Randy C Sims	1983-10-01	—	—	7983 Church St, Atlanta, GA	0.70	Two-digit birth year ZIP missing Placeholder values cleared
CLM-429457	CLM	Harold Barnes	1995-04-05	—	8725208417	683 Hillcrest Rd, Jacksonville, FL	0.72	Name re-cased Date of birth reformatted Phone reformatted City re-cased+4 more
CLM-400160	CLM	Jluie R Wilson	1965-12-07	UHC-58931-70	—	766 Washington St, Austin, TX	0.72	Name re-cased Date of birth reformatted Member ID reformatted State code upper-cased+4 more
CLM-416059	CLM	Sandra Campbell	1965-04-19	UHC-19891-88	—	2046 Central Ave, Mesa, AZ	0.72	Name split from “Last, First”ZIP missing
CLM-425637	CLM	Margaret Vgea	1938-05-15	—	—	8191 Grand Ave, Las Vegas, NV	0.72	Two-digit birth year ZIP missing

2,072 rows, page 33 of 42Previous Next